Jun 15 07:13:01 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:13:01 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:13:01 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:13:01 devstack cinder-volume[81205]: INFO dbcounter [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Registered counter for database cinder Jun 15 07:13:01 devstack cinder-volume[81205]: DEBUG oslo_db.sqlalchemy.engines [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG dbcounter [-] [81205] Writer thread running {{(pid=81205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.rpc [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.rpc [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_db.sqlalchemy.engines [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.volume.manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Determined volume DB was empty at startup. Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG cinder.volume.manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81205) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.volume.manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 15 07:13:02 devstack cinder-volume[81205]: WARNING stevedore.named [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:13:02 devstack cinder-volume[81205]: WARNING castellan.key_manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:02 devstack cinder-volume[81205]: WARNING cinder.keymgr.conf_key_mgr [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG cinder.volume.drivers.lvm [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81205) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_concurrency.processutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81205) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_concurrency.processutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] CMD "cinder-rtstool verify" returned: 0 in 0.361s {{(pid=81205) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_db.sqlalchemy.engines [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.rpc [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.rpc [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 15 07:13:02 devstack cinder-volume[81205]: WARNING stevedore.named [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:13:02 devstack cinder-volume[81205]: WARNING castellan.key_manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:13:02 devstack cinder-volume[81205]: INFO cinder.volume.manager [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_db.sqlalchemy.engines [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:02 devstack cinder-volume[81205]: INFO oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Starting 1 workers Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Started child 81361 {{(pid=81205) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Full set of CONF: {{(pid=81205) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] ******************************************************************************** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Configuration options gathered from: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] ================================================================================ {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] allow_availability_zone_fallback = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] allow_compression_on_image_upload = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81361]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] allowed_direct_url_schemes = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] api_rate_limit = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] auth_strategy = keystone {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] az_cache_duration = 3600 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_availability_zone = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_host = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_stats_polling_interval = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backup_api_class = cinder.backup.api.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backup_name_template = backup-%s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backup_use_same_host = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backup_use_temp_snapshot = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] chap_password = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] chap_username = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_internal_tenant_project_id = ed0de9efc29e41efb0f6953c7d74930c {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_internal_tenant_user_id = 9ae77f396f3f4cb7a6968cec934de210 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cloned_volume_same_az = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cluster = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] compression_format = gzip {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] compute_api_class = cinder.compute.nova.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] config_dir = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] config_source = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:02 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] control_exchange = openstack {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] debug = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] default_availability_zone = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] default_group_type = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] default_volume_type = lvmdriver-1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] disk_geometry = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_client_cert = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_client_cert_key = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_data_namespace = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_ssl_cert_path = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_ssl_cert_verify = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] driver_use_ssl = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] enable_force_upload = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] enable_new_services = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] enable_unsupported_driver = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] enforce_multipath_for_image_xfer = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] filter_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_api_insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_api_ssl_compression = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_ca_certificates_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_catalog_info = image:glance:publicURL {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_num_retries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance_request_timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] goodness_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] graceful_shutdown_timeout = 5 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] group_api_class = cinder.group.api.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] host = devstack {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_compress_on_upload = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_conversion_address_space_limit = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_conversion_cpu_limit = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_conversion_disable = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_upload_use_cinder_backend = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_upload_use_internal_tenant = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_volume_cache_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_volume_cache_max_count = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] image_volume_cache_max_size_gb = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] init_host_max_objects_retrieval = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] instance_format = [instance: %(uuid)s] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iscsi_target_flags = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iscsi_write_cache = on {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iser_helper = tgtadm {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iser_ip_address = 192.168.122.148 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iser_port = 3260 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_color = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_config_append = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_dir = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_options = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_rotate_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_rotate_interval_type = days {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] log_rotation_type = none {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] max_age = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] max_logfile_count = 30 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] max_logfile_size_mb = 200 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] max_over_subscription_ratio = 20.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] message_reap_interval = 86400 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] message_ttl = 2592000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] migration_create_volume_timeout_secs = 300 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] monkey_patch = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] monkey_patch_modules = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] my_ip = 192.168.122.148 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] no_snapshot_gb_quota = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] num_iser_scan_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] num_shell_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] num_volume_device_scan_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] nvmeof_conn_info_version = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] nvmet_ns_id = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] nvmet_port_id = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_max_limit = 1000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_ext_list = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_listen_port = 8776 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_use_ssl = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] osapi_volume_workers = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] per_volume_size_limit = -1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] periodic_fuzzy_delay = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] periodic_interval = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] public_endpoint = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] publish_errors = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_backup_gigabytes = 1000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_backups = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_gigabytes = 1000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_groups = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_snapshots = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] quota_volumes = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] rate_limit_burst = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] rate_limit_except_level = CRITICAL {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] rate_limit_interval = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] reinit_driver_count = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] replication_device = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] report_discard_supported = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] report_interval = 120 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] reservation_clean_interval = 86400 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] reservation_expire = 86400 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] reserved_image_namespaces = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] reserved_percentage = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] rpc_response_timeout = 120 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] run_external_periodic_tasks = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] scst_target_driver = iscsi {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] scst_target_iqn_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_down_time = 720 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] shell_completion = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] snapshot_name_template = snapshot-%s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] snapshot_same_host = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] split_loggers = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] state_path = /opt/stack/data/cinder {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] storage_availability_zone = nova {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] storage_protocol = iSCSI {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] syslog_log_facility = LOG_USER {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_helper = lioadm {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_ip_address = 192.168.122.148 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_port = 3260 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_protocol = iscsi {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] target_secondary_ip_addresses = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] trace_flags = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack sudo[81365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] transport_url = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack sudo[81365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] until_refresh = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_chap_auth = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_default_quota_class = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_journal = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_json = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_multipath_for_image_xfer = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_stderr = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] use_syslog = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] verify_glance_signatures = enabled {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_api_class = cinder.volume.api.API {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_backend_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_clear = zero {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_clear_ionice = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_clear_size = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_copy_bps_limit = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_dd_blocksize = 1M {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_name_template = volume-%s {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_service_inithost_offload = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volume_usage_audit_period = month {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] zoning_mode = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_concurrency.disable_process_locking = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.admin_password = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.admin_token = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.admin_user = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_port = 35357 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_protocol = https {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_section = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_type = password {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_uri = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.auth_version = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.cache = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.identity_uri = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.include_service_catalog = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.interface = public {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_password = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcache_username = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.region_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.service_type = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.backend = dogpile.cache.null {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.backend_argument = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.backend_expiration_time = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.config_prefix = cache.oslo {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.debug_cache_backend = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.enable_retry_client = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.enable_socket_keepalive = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.enforce_fips_mode = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.expiration_time = 600 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.hashclient_retry_attempts = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_dead_retry = 300 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_pool_maxsize = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_sasl_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.password = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.proxies = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.redis_db = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.redis_server = localhost:6379 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.retry_attempts = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.retry_delay = 0.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.socket_keepalive_count = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.socket_keepalive_idle = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.socket_keepalive_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.socket_timeout = 1.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.tls_allowed_ciphers = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.tls_cafile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.tls_certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.tls_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.tls_keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cache.username = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.asyncio_connection = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.asyncio_slave_connection = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.backend = sqlalchemy {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.connection = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.connection_debug = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.connection_parameters = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.connection_recycle_time = 3600 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.connection_trace = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.db_inc_retry_interval = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.db_max_retries = 20 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.db_max_retry_interval = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.db_retry_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.max_overflow = 50 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.max_pool_size = 5 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.max_retries = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.mysql_wsrep_sync_wait = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.pool_timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.retry_interval = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.slave_connection = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.sqlite_synchronous = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.synchronous_reader = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] database.use_db_reconnect = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.connection_string = messaging:// {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.es_doc_type = notification {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.es_scroll_size = 10000 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.es_scroll_time = 2m {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.filter_error_trace = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.hmac_keys = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.sentinel_service_name = mymaster {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.socket_timeout = 0.1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.trace_requests = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler.trace_sqlalchemy = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler_jaeger.process_tags = {} {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler_jaeger.service_name_prefix = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] profiler_otlp.service_name_prefix = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.enforce_new_defaults = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: WARNING oslo_config.cfg [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.enforce_scope = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.policy_default_rule = default {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.policy_file = policy.yaml {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] coordination.backend_url = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.group = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.helper_command = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] privsep_osbrick.user = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.group = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.helper_command = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] cinder_sys_admin.user = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.auth_section = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.auth_type = password {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.cafile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.collect_timing = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.send_service_user_token = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.split_loggers = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] service_user.timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.auth_section = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.auth_type = password {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.collect_timing = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.region_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.split_loggers = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] glance.timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.backend_availability_zone = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.chap_password = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.chap_username = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.disk_geometry = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_client_cert = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_client_cert_key = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_data_namespace = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.driver_use_ssl = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.extra_capabilities = {} {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.filter_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.goodness_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iscsi_target_flags = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iscsi_write_cache = on {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iser_helper = tgtadm {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iser_port = 3260 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.lvm_share_target = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.lvm_type = auto {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.num_shell_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.replication_device = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.report_discard_supported = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.reserved_percentage = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_helper = tgtadm {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_port = 3260 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_protocol = iscsi {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.trace_flags = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.unique_fqdn_network = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.use_chap_auth = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_backend_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_clear = zero {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_clear_ionice = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_clear_size = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_reports.file_event_handler = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_reports.log_dir = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.backend_host = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.chap_password = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.chap_username = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.disk_geometry = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_client_cert = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.extra_capabilities = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.filter_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.goodness_function = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iser_helper = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iser_ip_address = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iser_port = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.lvm_share_target = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.lvm_type = auto {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.num_shell_tries = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.replication_device = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.report_discard_supported = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.reserved_percentage = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.scst_target_driver = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.storage_protocol = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_helper = lioadm {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_ip_address = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_port = 3260 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.trace_flags = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.use_chap_auth = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_clear = zero {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_clear_size = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] lvmdriver-1.volumes_dir = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_notifications.driver = [] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_notifications.retry = -1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] key_manager.fixed_key = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.barbican_api_version = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.barbican_endpoint = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.barbican_endpoint_type = public {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.barbican_region_name = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.cafile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.collect_timing = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.number_of_retries = 60 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.retry_delay = 1 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.send_service_user_token = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.split_loggers = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.verify_ssl = True {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican.verify_ssl_path = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.auth_section = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.auth_type = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.cafile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.certfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.collect_timing = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.insecure = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.keyfile = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.split_loggers = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] barbican_service_user.timeout = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.approle_role_id = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.approle_secret_id = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.kv_mountpoint = secret {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.kv_path = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.kv_version = 2 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.namespace = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.root_token_id = **** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.ssl_ca_crt_file = None {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.timeout = 60.0 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.use_ssl = False {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:13:03 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] ******************************************************************************** {{(pid=81205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:13:03 devstack sudo[81365]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:03 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:03 devstack sudo[81451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:03 devstack sudo[81451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:04 devstack sudo[81451]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.569s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:13:04 devstack cinder-volume[81361]: INFO cinder.brick.local_dev.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:04 devstack sudo[81672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:04 devstack sudo[81672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:04 devstack sudo[81672]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG cinder.brick.local_dev.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81361) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 15 07:13:04 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:04 devstack sudo[81899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:04 devstack sudo[81899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:06 devstack sudo[81899]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.320s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:06 devstack sudo[82131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:06 devstack sudo[82131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:06 devstack sudo[82131]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:06 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:07 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:07 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:07 devstack sudo[82144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 15 07:13:07 devstack sudo[82144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:07 devstack sudo[82144]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:07 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.608s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:07 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:07 devstack sudo[82147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:07 devstack sudo[82147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:08 devstack sudo[82147]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:08 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:08 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:08 devstack sudo[82152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:08 devstack sudo[82152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:08 devstack sudo[82152]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:08 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:08 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:08 devstack sudo[82155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:08 devstack sudo[82155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:09 devstack sudo[82155]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:09 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.800s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:09 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:09 devstack sudo[82160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:09 devstack sudo[82160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:10 devstack sudo[82160]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:10 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.686s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:10 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:10 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:10 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:10 devstack sudo[82168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:10 devstack sudo[82168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:11 devstack sudo[82168]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:11 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.822s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:11 devstack cinder-volume[81361]: INFO cinder.volume.drivers.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 15 07:13:11 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:11 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:11 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:11 devstack sudo[82178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:11 devstack sudo[82178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:12 devstack sudo[82178]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:12 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.747s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:12 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:13:12 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:12 devstack sudo[82290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:12 devstack sudo[82290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:12 devstack sudo[82290]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:12 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:12 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:12 devstack sudo[82418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:12 devstack sudo[82418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:12 devstack cinder-volume[81205]: DEBUG dbcounter [-] [81205] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:13 devstack sudo[82418]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:13 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:13 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:13 devstack sudo[82438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:13 devstack sudo[82438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:13 devstack sudo[82438]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:13 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:13 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:13 devstack sudo[82444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:13 devstack sudo[82444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:14 devstack sudo[82444]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:14 devstack cinder-volume[81361]: INFO cinder.volume.driver [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG cinder.volume.driver [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81361) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writer thread running {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG cinder.db.sqlalchemy.api [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Building query based on filter {{(pid=81361) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG cinder.image.image_utils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81361) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:13:14 devstack cinder-volume[81361]: INFO cinder.keymgr.migration [None req-d81018ea-5a09-4a02-bb2b-4d92a0a5136b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:13:14 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:14 devstack sudo[82448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:14 devstack sudo[82448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:15 devstack sudo[82448]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:15 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.575s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:15 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:15 devstack sudo[82451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:15 devstack sudo[82451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:15 devstack sudo[82451]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:15 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:15 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:15 devstack sudo[82454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:15 devstack sudo[82454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:16 devstack sudo[82454]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:16 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:16 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:16 devstack sudo[82457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:16 devstack sudo[82457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:17 devstack sudo[82457]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG cinder.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Notifying Schedulers of capabilities ... {{(pid=81361) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:13:17 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Driver initialization completed successfully. Jun 15 07:13:17 devstack cinder-volume[81361]: INFO cinder.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Initiating service 2 cleanup Jun 15 07:13:17 devstack cinder-volume[81361]: INFO cinder.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Service 2 cleanup completed. Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG cinder.service [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Creating RPC server for service cinder-volume {{(pid=81361) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG cinder.service [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81361) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:13:17 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:17 devstack sudo[82464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:13:17 devstack sudo[82464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:17 devstack sudo[82464]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:17 devstack sudo[82468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:17 devstack sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:18 devstack sudo[82468]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:18 devstack sudo[82472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:13:18 devstack sudo[82472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:18 devstack sudo[82472]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.574s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:13:18 devstack sudo[82529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:13:18 devstack sudo[82529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:13:19 devstack sudo[82529]: pam_unix(sudo:session): session closed for user root Jun 15 07:13:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.579s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:13:19 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-5ad9a8a3-ffe3-4abc-bd22-4c73f03bcda5 None None] Driver post RPC initialization completed successfully. Jun 15 07:13:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:SELECT=3 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:13:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:14:17 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:14:17 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:14:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:17 devstack sudo[84462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:14:17 devstack sudo[84462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:18 devstack sudo[84462]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:18 devstack sudo[84467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:14:18 devstack sudo[84467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:18 devstack sudo[84467]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:18 devstack sudo[84567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:14:18 devstack sudo[84567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:19 devstack sudo[84567]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.578s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:14:19 devstack sudo[84699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:14:19 devstack sudo[84699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:14:19 devstack sudo[84699]: pam_unix(sudo:session): session closed for user root Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG cinder.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Notifying Schedulers of capabilities ... {{(pid=81361) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager._thread_info {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread count: 6 {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:14:19 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread info: [<_MainThread(MainThread, started 128683907698816)>, , , , , ] {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:15:17 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:15:17 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:15:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:17 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:15:17 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:18 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:18 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:15:18 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:18 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:18 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:15:18 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:19 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:15:19 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:15:19 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:15:19 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG cinder.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Notifying Schedulers of capabilities ... {{(pid=81361) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager._thread_info {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread count: 6 {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:15:19 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread info: [<_MainThread(MainThread, started 128683907698816)>, , , , , ] {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:15:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:SELECT=1 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:15:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:UPDATE=1 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:16:17 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:16:17 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:16:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:17 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:16:17 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:18 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:18 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:16:18 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:18 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:18 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:16:18 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:19 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:16:19 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:16:19 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:16:20 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Jun 15 07:16:20 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:16:20 devstack cinder-volume[81361]: DEBUG cinder.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Notifying Schedulers of capabilities ... {{(pid=81361) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:17 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:17:17 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Updating volume stats {{(pid=81361) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 15 07:17:17 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:17 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 15 07:17:17 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:18 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:18 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:17:18 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:18 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.593s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:18 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:18 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 15 07:17:18 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:19 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.579s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:19 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:19 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 15 07:17:19 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:20 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:20 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:20 devstack cinder-volume[81361]: DEBUG cinder.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Notifying Schedulers of capabilities ... {{(pid=81361) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:20 devstack cinder-volume[81361]: DEBUG oslo_service.periodic_task [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] Running periodic task VolumeManager._thread_info {{(pid=81361) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:17:20 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread count: 6 {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:17:20 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-ffcc1d29-ae22-4edd-904c-1f888fe06305 None None] thread info: [<_MainThread(MainThread, started 128683907698816)>, , , , , ] {{(pid=81361) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:17:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:SELECT=1 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:29 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:UPDATE=1 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:17:37 devstack cinder-volume[81205]: INFO oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Caught SIGTERM, stopping children Jun 15 07:17:37 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Acquiring lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:37 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Acquired lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:37 devstack cinder-volume[81205]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Releasing lock "singleton_lock" {{(pid=81205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:37 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Stop services. {{(pid=81205) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 15 07:17:37 devstack cinder-volume[81205]: DEBUG oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Killing children. {{(pid=81205) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 15 07:17:37 devstack cinder-volume[81205]: INFO oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Waiting on 1 children to exit Jun 15 07:17:37 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Acquiring lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:37 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Acquired lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:37 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Releasing lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:37 devstack cinder-volume[81361]: WARNING amqp [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:17:37 devstack cinder-volume[81361]: WARNING amqp [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:17:37 devstack cinder-volume[81205]: INFO oslo_service.backend._eventlet.service [None req-18b910d7-d02b-42fd-b8b3-26f7d12e8b05 None None] Child 81361 exited with status 0 Jun 15 07:17:39 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:39 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:39 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:40 devstack cinder-volume[91052]: INFO dbcounter [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Registered counter for database cinder Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG dbcounter [-] [91052] Writer thread running {{(pid=91052) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:17:40 devstack cinder-volume[91052]: INFO cinder.rpc [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:17:40 devstack cinder-volume[91052]: INFO cinder.rpc [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:40 devstack cinder-volume[91052]: INFO cinder.volume.manager [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Determined volume DB was empty at startup. Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG cinder.volume.manager [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91052) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:17:40 devstack cinder-volume[91052]: INFO cinder.volume.manager [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 15 07:17:40 devstack cinder-volume[91052]: WARNING stevedore.named [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:17:40 devstack cinder-volume[91052]: WARNING castellan.key_manager [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:17:40 devstack cinder-volume[91052]: WARNING cinder.keymgr.conf_key_mgr [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:17:40 devstack cinder-volume[91052]: INFO cinder.volume.manager [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_db.sqlalchemy.engines [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91052) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:40 devstack cinder-volume[91052]: INFO oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Starting 1 workers Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Started child 91244 {{(pid=91052) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Full set of CONF: {{(pid=91052) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] ******************************************************************************** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Configuration options gathered from: {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:17:40 devstack cinder-volume[91244]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] ================================================================================ {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] allow_availability_zone_fallback = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] allow_compression_on_image_upload = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] allowed_direct_url_schemes = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] api_rate_limit = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] auth_strategy = keystone {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_availability_zone = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_host = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_stats_polling_interval = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backup_api_class = cinder.backup.api.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backup_name_template = backup-%s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backup_use_same_host = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backup_use_temp_snapshot = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] chap_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] chap_username = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_internal_tenant_project_id = ed0de9efc29e41efb0f6953c7d74930c {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_internal_tenant_user_id = 9ae77f396f3f4cb7a6968cec934de210 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cluster = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] compression_format = gzip {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] compute_api_class = cinder.compute.nova.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] config_dir = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] config_source = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] control_exchange = openstack {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] debug = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] default_availability_zone = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] default_group_type = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] default_volume_type = QuobyteHD {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] disk_geometry = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_client_cert = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_client_cert_key = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_data_namespace = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_ssl_cert_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_ssl_cert_verify = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] driver_use_ssl = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] enable_new_services = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] enable_unsupported_driver = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] enabled_backends = ['QuobyteHD'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] enforce_multipath_for_image_xfer = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] filter_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_api_insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_api_ssl_compression = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_ca_certificates_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_catalog_info = image:glance:publicURL {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_num_retries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance_request_timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] goodness_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] graceful_shutdown_timeout = 5 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] group_api_class = cinder.group.api.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] host = devstack {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_compress_on_upload = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_conversion_address_space_limit = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_conversion_cpu_limit = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_conversion_disable = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_upload_use_cinder_backend = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_upload_use_internal_tenant = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_volume_cache_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_volume_cache_max_count = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] image_volume_cache_max_size_gb = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] init_host_max_objects_retrieval = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] instance_format = [instance: %(uuid)s] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iscsi_target_flags = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iscsi_write_cache = on {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iser_helper = tgtadm {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iser_ip_address = 192.168.122.148 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iser_port = 3260 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_color = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_config_append = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_dir = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_options = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_rotate_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_rotate_interval_type = days {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] log_rotation_type = none {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] max_age = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] max_logfile_count = 30 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] max_logfile_size_mb = 200 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] max_over_subscription_ratio = 20.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] message_reap_interval = 86400 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] message_ttl = 2592000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] migration_create_volume_timeout_secs = 300 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] monkey_patch = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] monkey_patch_modules = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] my_ip = 192.168.122.148 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] no_snapshot_gb_quota = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] num_iser_scan_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] num_shell_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] num_volume_device_scan_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] nvmeof_conn_info_version = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] nvmet_ns_id = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] nvmet_port_id = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_max_limit = 1000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_ext_list = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91244]: INFO cinder.volume.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Starting volume driver QuobyteDriver (1.1.14) Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.remotefs [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91244) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_listen_port = 8776 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_use_ssl = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] osapi_volume_workers = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] per_volume_size_limit = -1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] periodic_fuzzy_delay = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] periodic_interval = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] public_endpoint = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] publish_errors = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_backup_gigabytes = 1000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_backups = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_gigabytes = 1000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_groups = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_snapshots = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] quota_volumes = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] rate_limit_burst = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] rate_limit_except_level = CRITICAL {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] rate_limit_interval = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] reinit_driver_count = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] replication_device = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] report_discard_supported = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] report_interval = 120 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] reservation_clean_interval = 86400 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] reservation_expire = 86400 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] reserved_image_namespaces = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] reserved_percentage = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] rpc_response_timeout = 120 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] run_external_periodic_tasks = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] scst_target_driver = iscsi {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] scst_target_iqn_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_down_time = 720 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] shell_completion = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] snapshot_name_template = snapshot-%s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] split_loggers = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] state_path = /opt/stack/data/cinder {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] storage_availability_zone = nova {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] storage_protocol = iSCSI {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] syslog_log_facility = LOG_USER {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_helper = lioadm {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_ip_address = 192.168.122.148 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_port = 3260 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_protocol = iscsi {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] target_secondary_ip_addresses = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] trace_flags = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] transport_url = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] until_refresh = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_chap_auth = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_default_quota_class = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_journal = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_json = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_multipath_for_image_xfer = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_stderr = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] use_syslog = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] verify_glance_signatures = enabled {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_api_class = cinder.volume.api.API {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_backend_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_clear = zero {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_clear_ionice = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_clear_size = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_copy_bps_limit = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_dd_blocksize = 1M {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_name_template = volume-%s {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_service_inithost_offload = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volume_usage_audit_period = month {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] zoning_mode = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.admin_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.admin_token = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.admin_user = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_port = 35357 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_protocol = https {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_section = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_type = password {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_uri = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.auth_version = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.cache = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.identity_uri = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.include_service_catalog = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.interface = public {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_password = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcache_username = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.region_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.service_type = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.backend = dogpile.cache.null {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.backend_argument = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.backend_expiration_time = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.config_prefix = cache.oslo {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.debug_cache_backend = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.enable_retry_client = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.enable_socket_keepalive = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.enforce_fips_mode = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.expiration_time = 600 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_dead_retry = 300 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_pool_maxsize = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_sasl_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.proxies = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.redis_db = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.redis_server = localhost:6379 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.retry_attempts = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.retry_delay = 0.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.socket_keepalive_count = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.socket_keepalive_idle = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.socket_keepalive_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.socket_timeout = 1.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.tls_allowed_ciphers = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.tls_cafile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.tls_certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.tls_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.tls_keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cache.username = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.asyncio_connection = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.asyncio_slave_connection = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.backend = sqlalchemy {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.connection = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.connection_debug = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.connection_parameters = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.connection_recycle_time = 3600 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.connection_trace = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.db_inc_retry_interval = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.db_max_retries = 20 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.db_max_retry_interval = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.db_retry_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.max_overflow = 50 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.max_pool_size = 5 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.max_retries = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.pool_timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.retry_interval = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.slave_connection = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.sqlite_synchronous = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91244) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 15 07:17:40 devstack cinder-volume[91244]: WARNING cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 15 07:17:40 devstack cinder-volume[91244]: WARNING cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 15 07:17:40 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Running cmd (subprocess): mount.quobyte {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.synchronous_reader = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] database.use_db_reconnect = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.connection_string = messaging:// {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.es_doc_type = notification {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.es_scroll_size = 10000 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.es_scroll_time = 2m {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.filter_error_trace = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.hmac_keys = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.sentinel_service_name = mymaster {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.socket_timeout = 0.1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.trace_requests = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler.trace_sqlalchemy = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler_jaeger.process_tags = {} {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] profiler_otlp.service_name_prefix = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.enforce_new_defaults = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: WARNING oslo_config.cfg [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.enforce_scope = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.policy_default_rule = default {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.policy_file = policy.yaml {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] coordination.backend_url = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.group = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.helper_command = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] privsep_osbrick.user = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.group = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.helper_command = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] cinder_sys_admin.user = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.auth_section = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.auth_type = password {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.cafile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.collect_timing = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.send_service_user_token = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.split_loggers = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] service_user.timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.auth_section = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.auth_type = password {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.collect_timing = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.region_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.split_loggers = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] glance.timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.backend_availability_zone = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.chap_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.chap_username = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.disk_geometry = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_client_cert = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_client_cert_key = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_data_namespace = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.driver_use_ssl = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.extra_capabilities = {} {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.filter_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.goodness_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iscsi_target_flags = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iscsi_write_cache = on {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iser_helper = tgtadm {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iser_port = 3260 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_host = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_login = admin {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_mount_options = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_private_key = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_share_path = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.num_shell_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.quobyte_volume_url = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.replication_device = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.report_discard_supported = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.reserved_percentage = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_helper = tgtadm {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_port = 3260 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:40 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_protocol = iscsi {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.trace_flags = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.unique_fqdn_network = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.use_chap_auth = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_backend_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_clear = zero {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_clear_ionice = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_clear_size = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_reports.file_event_handler = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_reports.log_dir = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.backend_availability_zone = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.backend_host = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.chap_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.chap_username = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.chiscsi_conf = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.disk_geometry = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_client_cert = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_data_namespace = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.driver_use_ssl = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.extra_capabilities = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.filter_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.goodness_function = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iser_helper = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iser_ip_address = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iser_port = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.iser_target_prefix = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_host = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_login = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_mount_options = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_password = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_private_key = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_share_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_ssh_port = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.num_shell_tries = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.nvmet_port_id = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.replication_device = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.report_discard_supported = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.reserved_percentage = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.scst_target_driver = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.storage_protocol = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_helper = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_ip_address = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_port = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_prefix = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_protocol = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.trace_flags = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.use_chap_auth = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_clear = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_clear_size = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] QuobyteHD.volumes_dir = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_notifications.driver = [] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] key_manager.fixed_key = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.barbican_api_version = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.barbican_endpoint = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.barbican_endpoint_type = public {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.barbican_region_name = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.cafile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.collect_timing = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.number_of_retries = 60 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.retry_delay = 1 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.send_service_user_token = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.split_loggers = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.verify_ssl = True {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican.verify_ssl_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.auth_section = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.auth_type = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.cafile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.certfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.collect_timing = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.insecure = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.keyfile = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.split_loggers = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] barbican_service_user.timeout = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.approle_role_id = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.approle_secret_id = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.kv_mountpoint = secret {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.kv_path = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.kv_version = 2 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.namespace = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.root_token_id = **** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.ssl_ca_crt_file = None {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.timeout = 60.0 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.use_ssl = False {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:41 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] ******************************************************************************** {{(pid=91052) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:17:41 devstack quobyte-client[91284]: Reading configuration file: /etc/quobyte/client.cfg Jun 15 07:17:41 devstack quobyte-client[91284]: Invalid parameters found, error: missing mount point. Jun 15 07:17:41 devstack quobyte-client[91284]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 15 07:17:41 devstack quobyte-client[91284]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] CMD "mount.quobyte" returned: 1 in 0.199s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:41 devstack cinder-volume[91244]: INFO cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d ... Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b -c /etc/quobyte/client-cinder.cfg {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:41 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b -c /etc/quobyte/client-cinder.cfg Jun 15 07:17:41 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:41 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.755s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:41 devstack cinder-volume[91244]: INFO cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d succeeded Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.765s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:41 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:41 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:41 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:42 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.571s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:42 devstack cinder-volume[91244]: INFO cinder.volume.driver [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG cinder.volume.driver [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7555618286133, 'free_capacity_gb': 1775.7555618286133, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91244) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_db.sqlalchemy.engines [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91244) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG dbcounter [-] [91244] Writer thread running {{(pid=91244) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG cinder.db.sqlalchemy.api [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Building query based on filter {{(pid=91244) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG cinder.image.image_utils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91244) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:17:42 devstack cinder-volume[91244]: INFO cinder.keymgr.migration [None req-287117a5-cb15-4bcd-ac39-4a93db93adee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:42 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:42 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:42 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:43 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.586s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG cinder.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Notifying Schedulers of capabilities ... {{(pid=91244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:43 devstack cinder-volume[91244]: INFO cinder.volume.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Driver initialization completed successfully. Jun 15 07:17:43 devstack cinder-volume[91244]: INFO cinder.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Initiating service 3 cleanup Jun 15 07:17:43 devstack cinder-volume[91244]: INFO cinder.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Service 3 cleanup completed. Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG cinder.service [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Creating RPC server for service cinder-volume {{(pid=91244) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG cinder.service [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91244) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:17:43 devstack cinder-volume[91244]: INFO cinder.volume.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:43 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:43 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:43 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:43 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.640s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:43 devstack cinder-volume[91244]: INFO cinder.volume.manager [None req-6dc26ec0-6561-4a35-968c-4dcec2ea245b None None] Driver post RPC initialization completed successfully. Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91244) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG cinder.volume.drivers.quobyte [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91244) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91244) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:47 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:47 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:47 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:48 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:48 devstack cinder-volume[91244]: DEBUG oslo_concurrency.processutils [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.586s {{(pid=91244) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:48 devstack cinder-volume[91244]: DEBUG cinder.manager [None req-05a02916-7ac6-4640-856c-8a55c2a3c718 None None] Notifying Schedulers of capabilities ... {{(pid=91244) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:48 devstack cinder-volume[91052]: INFO oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Caught SIGTERM, stopping children Jun 15 07:17:48 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Acquiring lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:48 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Acquired lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:48 devstack cinder-volume[91052]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Releasing lock "singleton_lock" {{(pid=91052) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:48 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Stop services. {{(pid=91052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 15 07:17:48 devstack cinder-volume[91052]: DEBUG oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Killing children. {{(pid=91052) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 15 07:17:48 devstack cinder-volume[91052]: INFO oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Waiting on 1 children to exit Jun 15 07:17:51 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Acquiring lock "singleton_lock" {{(pid=91244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:51 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Acquired lock "singleton_lock" {{(pid=91244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:51 devstack cinder-volume[91244]: DEBUG oslo_concurrency.lockutils [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Releasing lock "singleton_lock" {{(pid=91244) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:51 devstack cinder-volume[91244]: WARNING amqp [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:17:51 devstack cinder-volume[91244]: WARNING amqp [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 15 07:17:51 devstack cinder-volume[91052]: INFO oslo_service.backend._eventlet.service [None req-9bd8789f-1416-4a15-8b5e-8f80df20d7f3 None None] Child 91244 exited with status 0 Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 15 07:17:55 devstack cinder-volume[91587]: INFO dbcounter [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Registered counter for database cinder Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG oslo_db.sqlalchemy.engines [None req-377bf522-aa86-422e-b206-2072765c8245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG dbcounter [-] [91587] Writer thread running {{(pid=91587) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:17:55 devstack cinder-volume[91587]: INFO cinder.rpc [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 15 07:17:55 devstack cinder-volume[91587]: INFO cinder.rpc [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 15 07:17:55 devstack cinder-volume[91587]: DEBUG oslo_db.sqlalchemy.engines [None req-377bf522-aa86-422e-b206-2072765c8245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:56 devstack cinder-volume[91587]: INFO cinder.volume.manager [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Determined volume DB was empty at startup. Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG cinder.volume.manager [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91587) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 15 07:17:56 devstack cinder-volume[91587]: WARNING stevedore.named [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 15 07:17:56 devstack cinder-volume[91587]: WARNING castellan.key_manager [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:17:56 devstack cinder-volume[91587]: WARNING cinder.keymgr.conf_key_mgr [None req-377bf522-aa86-422e-b206-2072765c8245 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 15 07:17:56 devstack cinder-volume[91587]: INFO cinder.volume.manager [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_db.sqlalchemy.engines [None req-377bf522-aa86-422e-b206-2072765c8245 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:56 devstack cinder-volume[91587]: INFO oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Starting 1 workers Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Started child 91865 {{(pid=91587) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Full set of CONF: {{(pid=91587) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] ******************************************************************************** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Configuration options gathered from: {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] ================================================================================ {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] allow_availability_zone_fallback = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] allow_compression_on_image_upload = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] allowed_direct_url_schemes = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] api_rate_limit = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] auth_strategy = keystone {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_availability_zone = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_host = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91865]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_stats_polling_interval = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backup_api_class = cinder.backup.api.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backup_name_template = backup-%s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backup_use_same_host = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backup_use_temp_snapshot = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] chap_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] chap_username = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_internal_tenant_project_id = ed0de9efc29e41efb0f6953c7d74930c {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_internal_tenant_user_id = 9ae77f396f3f4cb7a6968cec934de210 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cluster = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] compression_format = gzip {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] compute_api_class = cinder.compute.nova.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] config_dir = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] config_source = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] control_exchange = openstack {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] debug = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] default_availability_zone = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] default_group_type = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] default_volume_type = QuobyteHD {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] disk_geometry = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_client_cert = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_client_cert_key = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_data_namespace = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_ssl_cert_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_ssl_cert_verify = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] driver_use_ssl = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] enable_new_services = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] enable_unsupported_driver = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] enabled_backends = ['QuobyteHD'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] enforce_multipath_for_image_xfer = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] filter_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_api_insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_api_ssl_compression = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_ca_certificates_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_catalog_info = image:glance:publicURL {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_num_retries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance_request_timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] goodness_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] graceful_shutdown_timeout = 5 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] group_api_class = cinder.group.api.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] host = devstack {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_compress_on_upload = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_conversion_address_space_limit = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_conversion_cpu_limit = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_conversion_disable = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_upload_use_cinder_backend = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_upload_use_internal_tenant = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_volume_cache_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_volume_cache_max_count = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] image_volume_cache_max_size_gb = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] init_host_max_objects_retrieval = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] instance_format = [instance: %(uuid)s] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iscsi_target_flags = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iscsi_write_cache = on {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iser_helper = tgtadm {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iser_ip_address = 192.168.122.148 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iser_port = 3260 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_color = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_config_append = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_dir = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_options = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_rotate_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_rotate_interval_type = days {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] log_rotation_type = none {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] max_age = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] max_logfile_count = 30 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] max_logfile_size_mb = 200 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] max_over_subscription_ratio = 20.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] message_reap_interval = 86400 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] message_ttl = 2592000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] migration_create_volume_timeout_secs = 300 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] monkey_patch = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] monkey_patch_modules = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] my_ip = 192.168.122.148 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] no_snapshot_gb_quota = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] num_iser_scan_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] num_shell_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] num_volume_device_scan_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] nvmeof_conn_info_version = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] nvmet_ns_id = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] nvmet_port_id = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_max_limit = 1000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_ext_list = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_listen_port = 8776 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_use_ssl = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] osapi_volume_workers = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] per_volume_size_limit = -1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] periodic_fuzzy_delay = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] periodic_interval = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] public_endpoint = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] publish_errors = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_backup_gigabytes = 1000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_backups = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_gigabytes = 1000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_groups = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_snapshots = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] quota_volumes = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] rate_limit_burst = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] rate_limit_except_level = CRITICAL {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] rate_limit_interval = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] reinit_driver_count = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] replication_device = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] report_discard_supported = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] report_interval = 120 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] reservation_clean_interval = 86400 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] reservation_expire = 86400 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] reserved_image_namespaces = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] reserved_percentage = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] rpc_response_timeout = 120 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] run_external_periodic_tasks = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] scst_target_driver = iscsi {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] scst_target_iqn_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_down_time = 720 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] shell_completion = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] snapshot_name_template = snapshot-%s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] split_loggers = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] state_path = /opt/stack/data/cinder {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] storage_availability_zone = nova {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] storage_protocol = iSCSI {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] syslog_log_facility = LOG_USER {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_helper = lioadm {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_ip_address = 192.168.122.148 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_port = 3260 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_protocol = iscsi {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] target_secondary_ip_addresses = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] trace_flags = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] transport_url = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] until_refresh = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_chap_auth = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_default_quota_class = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_journal = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_json = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_multipath_for_image_xfer = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_stderr = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] use_syslog = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] verify_glance_signatures = enabled {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91865) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_api_class = cinder.volume.api.API {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_backend_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_clear = zero {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_clear_ionice = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_clear_size = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_copy_bps_limit = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_dd_blocksize = 1M {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_name_template = volume-%s {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_service_inithost_offload = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volume_usage_audit_period = month {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] zoning_mode = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_concurrency.disable_process_locking = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.admin_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.admin_token = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.admin_user = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_port = 35357 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_protocol = https {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_section = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_type = password {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_uri = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.auth_version = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.cache = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.identity_uri = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.include_service_catalog = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.interface = public {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_password = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcache_username = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.region_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.service_type = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.backend = dogpile.cache.null {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.backend_argument = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.backend_expiration_time = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.config_prefix = cache.oslo {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.debug_cache_backend = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.enable_retry_client = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.enable_socket_keepalive = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.enforce_fips_mode = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.expiration_time = 600 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.hashclient_retry_attempts = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_dead_retry = 300 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_pool_maxsize = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_sasl_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.proxies = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.redis_db = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.redis_server = localhost:6379 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.retry_attempts = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.retry_delay = 0.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.socket_keepalive_count = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.socket_keepalive_idle = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.socket_keepalive_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.socket_timeout = 1.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.tls_allowed_ciphers = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.tls_cafile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.tls_certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.tls_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.tls_keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cache.username = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.asyncio_connection = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.asyncio_slave_connection = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.backend = sqlalchemy {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.connection = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.connection_debug = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.connection_parameters = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.connection_recycle_time = 3600 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.connection_trace = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.db_inc_retry_interval = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.db_max_retries = 20 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.db_max_retry_interval = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.db_retry_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.max_overflow = 50 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.max_pool_size = 5 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.max_retries = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.mysql_wsrep_sync_wait = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.pool_timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.retry_interval = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.slave_connection = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.sqlite_synchronous = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.synchronous_reader = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] database.use_db_reconnect = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.connection_string = messaging:// {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.es_doc_type = notification {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.es_scroll_size = 10000 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.es_scroll_time = 2m {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.filter_error_trace = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.hmac_keys = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.sentinel_service_name = mymaster {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.socket_timeout = 0.1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.trace_requests = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler.trace_sqlalchemy = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler_jaeger.process_tags = {} {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler_jaeger.service_name_prefix = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] profiler_otlp.service_name_prefix = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.enforce_new_defaults = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: WARNING oslo_config.cfg [None req-377bf522-aa86-422e-b206-2072765c8245 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.enforce_scope = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.policy_default_rule = default {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.policy_file = policy.yaml {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] coordination.backend_url = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.group = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.helper_command = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] privsep_osbrick.user = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.group = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.helper_command = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] cinder_sys_admin.user = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.auth_section = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.auth_type = password {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.cafile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.collect_timing = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.send_service_user_token = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.split_loggers = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] service_user.timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.auth_section = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.auth_type = password {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.collect_timing = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.region_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.split_loggers = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] glance.timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.backend_availability_zone = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.chap_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.chap_username = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.disk_geometry = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_client_cert = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_client_cert_key = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_data_namespace = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.driver_use_ssl = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.extra_capabilities = {} {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.filter_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.goodness_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iscsi_target_flags = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iscsi_write_cache = on {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iser_helper = tgtadm {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iser_port = 3260 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_host = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_login = admin {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_mount_options = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_private_key = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_share_path = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.num_shell_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.quobyte_volume_url = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.replication_device = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.report_discard_supported = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.reserved_percentage = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_helper = tgtadm {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_port = 3260 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_protocol = iscsi {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.trace_flags = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.unique_fqdn_network = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.use_chap_auth = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_backend_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_clear = zero {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_clear_ionice = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_clear_size = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_reports.file_event_handler = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_reports.log_dir = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.backend_availability_zone = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.backend_host = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.chap_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.chap_username = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.chiscsi_conf = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.disk_geometry = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_client_cert = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_data_namespace = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.driver_use_ssl = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.extra_capabilities = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.filter_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.goodness_function = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iser_helper = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iser_ip_address = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iser_port = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.iser_target_prefix = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_host = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_login = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_mount_options = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_password = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_private_key = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_share_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_ssh_port = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.num_shell_tries = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.nvmet_port_id = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.replication_device = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.report_discard_supported = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.reserved_percentage = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.scst_target_driver = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91865) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.storage_protocol = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_helper = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_ip_address = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_port = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_prefix = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_protocol = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.trace_flags = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.use_chap_auth = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_clear = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_clear_size = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] QuobyteHD.volumes_dir = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 15 07:17:56 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Running cmd (subprocess): mount.quobyte {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_notifications.driver = [] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_notifications.retry = -1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] key_manager.fixed_key = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.barbican_api_version = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.barbican_endpoint = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.barbican_endpoint_type = public {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.barbican_region_name = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.cafile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.collect_timing = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.number_of_retries = 60 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.retry_delay = 1 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.send_service_user_token = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.split_loggers = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.verify_ssl = True {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican.verify_ssl_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.auth_section = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.auth_type = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.cafile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.certfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.collect_timing = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.insecure = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.keyfile = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.split_loggers = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] barbican_service_user.timeout = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.approle_role_id = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.approle_secret_id = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.kv_mountpoint = secret {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.kv_path = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.kv_version = 2 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.namespace = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.root_token_id = **** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.ssl_ca_crt_file = None {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.timeout = 60.0 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.use_ssl = False {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 15 07:17:56 devstack cinder-volume[91587]: DEBUG oslo_service.backend._eventlet.service [None req-377bf522-aa86-422e-b206-2072765c8245 None None] ******************************************************************************** {{(pid=91587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 15 07:17:56 devstack quobyte-client[91874]: Reading configuration file: /etc/quobyte/client.cfg Jun 15 07:17:56 devstack quobyte-client[91874]: Invalid parameters found, error: missing mount point. Jun 15 07:17:56 devstack quobyte-client[91874]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 15 07:17:56 devstack quobyte-client[91874]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:56 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:56 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:57 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.595s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.volume.driver [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Driver hasn't implemented _init_vendor_properties() Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.volume.driver [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548751831055, 'free_capacity_gb': 1775.7548751831055, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91865) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_db.sqlalchemy.engines [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writer thread running {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.db.sqlalchemy.api [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Building query based on filter {{(pid=91865) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91865) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.keymgr.migration [None req-b970084a-6ba5-40cc-a059-36a65c42b363 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 15 07:17:57 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:57 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:57 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.639s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Driver initialization completed successfully. Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Initiating service 3 cleanup Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Service 3 cleanup completed. Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.service [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Creating RPC server for service cinder-volume {{(pid=91865) start /opt/stack/cinder/cinder/service.py:231}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.service [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91865) start /opt/stack/cinder/cinder/service.py:237}} Jun 15 07:17:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:17:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:17:57 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:17:57 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:17:58 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Jun 15 07:17:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.597s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:17:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2009854a-1e50-4965-927e-6ab304e2fe52 None None] Driver post RPC initialization completed successfully. Jun 15 07:18:06 devstack cinder-volume[91587]: DEBUG dbcounter [-] [91587] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91587) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:07 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:08 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:18:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:18:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 6 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:18:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Flow 'volume_create_manager' (1c1a9e1b-1fac-4ea8-bb20-4a8c0009ccad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65482f5-3205-4fb5-8c11-2582351642ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65482f5-3205-4fb5-8c11-2582351642ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1127934870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d40793-b6a2-43c0-a8f5-eb3946d9195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e9a08264f9449fa22a2965fbca0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:18:56Z,use_quota=True,user_id='95d4c50a26be45739335453ed32ce80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f6785b-58b2-4a9d-b34e-17b53f4de5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f6785b-58b2-4a9d-b34e-17b53f4de5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e42aca-a888-43dc-b44f-d7f3f58c6ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e42aca-a888-43dc-b44f-d7f3f58c6ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d40793-b6a2-43c0-a8f5-eb3946d9195a', 'volume_name': 'volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e404a73-0cdd-4536-b415-9128626683b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e404a73-0cdd-4536-b415-9128626683b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c58ce7-4905-4493-9e3e-471f6ea5fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Volume 46d40793-b6a2-43c0-a8f5-eb3946d9195a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a', 'volume_size': 1} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1127934870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d40793-b6a2-43c0-a8f5-eb3946d9195a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51e9a08264f9449fa22a2965fbca0f87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:18:56Z,use_quota=True,user_id='95d4c50a26be45739335453ed32ce80f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Creating volume 46d40793-b6a2-43c0-a8f5-eb3946d9195a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:18:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:18:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:18:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:18:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:18:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:56 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a 1073741824 Jun 15 07:18:56 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:57 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a 1073741824" returned: 0 in 1.214s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:18:57 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a Jun 15 07:18:57 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:18:58 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a" returned: 0 in 0.900s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c58ce7-4905-4493-9e3e-471f6ea5fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2aa0d4c-b1ca-4bca-b118-3335a24c8385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:18:58 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Volume volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a (46d40793-b6a2-43c0-a8f5-eb3946d9195a): created successfully Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2aa0d4c-b1ca-4bca-b118-3335a24c8385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:18:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Flow 'volume_create_manager' (1c1a9e1b-1fac-4ea8-bb20-4a8c0009ccad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:18:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-bece724a-72e5-4da1-82a5-01b779c087dd tempest-TaggedAttachmentsTest-389687830 None] Created volume successfully. Jun 15 07:19:08 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:08 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Flow 'volume_create_manager' (1317aef8-ed15-4a0d-97c6-7c6061a3a73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb90bb9-05f6-4c4b-8edf-7b0e509ab589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb90bb9-05f6-4c4b-8edf-7b0e509ab589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1183662947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c28a75-19ad-430d-9c8f-00a02b6a5dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f15eba494b4e7280b820dcec417d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:29Z,use_quota=True,user_id='bd770ad0921946eaa988cd2bb5baf5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eb7cbf-1587-49ea-ae63-6cf6ca7656c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eb7cbf-1587-49ea-ae63-6cf6ca7656c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6bc629-0ae1-4986-ac31-0eca9d00001a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6bc629-0ae1-4986-ac31-0eca9d00001a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0c28a75-19ad-430d-9c8f-00a02b6a5dfa', 'volume_name': 'volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cf0bce-66bd-4414-bfeb-ebd8dbc07f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cf0bce-66bd-4414-bfeb-ebd8dbc07f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8947ef56-5bc9-46f0-892d-18f2cc53939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:29 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Volume a0c28a75-19ad-430d-9c8f-00a02b6a5dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa', 'volume_size': 1} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1183662947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c28a75-19ad-430d-9c8f-00a02b6a5dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5f15eba494b4e7280b820dcec417d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:29Z,use_quota=True,user_id='bd770ad0921946eaa988cd2bb5baf5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Creating volume a0c28a75-19ad-430d-9c8f-00a02b6a5dfa {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:29 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:19:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:29 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa 1073741824 Jun 15 07:19:29 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:31 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa 1073741824" returned: 0 in 1.668s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:31 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa Jun 15 07:19:31 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:33 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" returned: 0 in 1.858s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] <== create_volume: return (3660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.663s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8947ef56-5bc9-46f0-892d-18f2cc53939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a348ac9-d846-48aa-bcc8-cb270e02d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Volume volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa (a0c28a75-19ad-430d-9c8f-00a02b6a5dfa): created successfully Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a348ac9-d846-48aa-bcc8-cb270e02d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Flow 'volume_create_manager' (1317aef8-ed15-4a0d-97c6-7c6061a3a73b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:33 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3b0ffd5e-938a-4d69-9635-3a793169da38 tempest-VolumesAdminNegativeTest-374505491 None] Created volume successfully. Jun 15 07:19:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Acquiring lock "cinder-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "cinder-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Acquiring lock "cinder-quobyte-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:19:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "cinder-quobyte-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" acquired by "delete_volume" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:19:35 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpydjs4vy1/privsep.sock'] Jun 15 07:19:35 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpydjs4vy1/privsep.sock Jun 15 07:19:35 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:38 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:38 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Spawned new privsep daemon via rootwrap Jun 15 07:19:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Accepted privsep connection to /tmp/tmpydjs4vy1/privsep.sock {{(pid=91865) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 15 07:19:38 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 15 07:19:38 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 15 07:19:38 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 15 07:19:38 devstack cinder-volume[91865]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92934 Jun 15 07:19:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[968b9386-35d6-424e-aa77-f1f58cf0559f]: (2,) {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[91449e18-19c7-4d64-a2ee-da14267c6c60]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:19:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:38 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa Jun 15 07:19:38 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:40 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" returned: 0 in 2.385s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:40 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa Jun 15 07:19:40 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:42 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" returned: 0 in 2.130s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "cinder-quobyte-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa" released by "delete_volume" :: held 7.117s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:42 devstack cinder-volume[91865]: WARNING cinder.quota [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:19:42 devstack cinder-volume[91865]: WARNING cinder.quota [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:19:42 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Created reservations ['63a84465-dce1-4870-a04b-ff09fb1ac741', '904a3d21-c4a4-4b56-9bdf-c0534b11b6dc', 'ad57f176-cf30-426a-be18-62b055aba41c', '3b3aecc9-ef06-4d52-af09-c146fb418843'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:43 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:19:43 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:44 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.275s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:44 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Deleted volume successfully. Jun 15 07:19:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0cd68f3-4e64-4f7a-9e2c-ae6ae0e74d41 tempest-VolumesAdminNegativeTest-374505491 None] Lock "cinder-a0c28a75-19ad-430d-9c8f-00a02b6a5dfa-delete_volume" released by "delete_volume" :: held 9.005s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:46 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:19:46 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:47 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.830s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:19:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:19:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:19:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:19:53 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=4,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:54 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:19:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Flow 'volume_create_manager' (6b52924b-a011-4b14-897d-85f616207e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaaf88e-e817-4dc3-9705-1f61c9199011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eaaf88e-e817-4dc3-9705-1f61c9199011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1326817169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f588e116-2139-4ba1-80e3-0abc5c702674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='060b7321c3c847138baccd9275b5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:56Z,use_quota=True,user_id='254caf7fbd9a4002bd5479e7225df459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0c22d9-41a8-4f90-9133-d757c53292e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0c22d9-41a8-4f90-9133-d757c53292e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b48dfc-2eff-4228-b129-1359392fc854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b48dfc-2eff-4228-b129-1359392fc854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f588e116-2139-4ba1-80e3-0abc5c702674', 'volume_name': 'volume-f588e116-2139-4ba1-80e3-0abc5c702674', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d40948d-bb2e-4c7b-814b-5c58ba06d6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d40948d-bb2e-4c7b-814b-5c58ba06d6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f22cec-4712-4bc7-af7e-1a223ab19575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:56 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Volume f588e116-2139-4ba1-80e3-0abc5c702674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f588e116-2139-4ba1-80e3-0abc5c702674', 'volume_size': 1} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1326817169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f588e116-2139-4ba1-80e3-0abc5c702674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='060b7321c3c847138baccd9275b5678b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:19:56Z,use_quota=True,user_id='254caf7fbd9a4002bd5479e7225df459',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Creating volume f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:19:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:19:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:56 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 1073741824 Jun 15 07:19:56 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:57 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 1073741824" returned: 0 in 1.233s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:19:57 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 Jun 15 07:19:57 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:19:58 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674" returned: 0 in 0.925s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f22cec-4712-4bc7-af7e-1a223ab19575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f588e116-2139-4ba1-80e3-0abc5c702674', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145e0e21-df0c-41d0-bf33-253c5db781ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:19:58 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Volume volume-f588e116-2139-4ba1-80e3-0abc5c702674 (f588e116-2139-4ba1-80e3-0abc5c702674): created successfully Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145e0e21-df0c-41d0-bf33-253c5db781ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:19:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Flow 'volume_create_manager' (6b52924b-a011-4b14-897d-85f616207e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:19:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2c6c46a6-d04d-4877-bc69-13ab19736d69 tempest-ServerActionsTestOtherA-425211984 None] Created volume successfully. Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Flow 'volume_create_manager' (3c8e3ac6-6120-42ab-b511-56014ef060bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bb22e2-d7e2-4778-8f60-3c1ed805e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bb22e2-d7e2-4778-8f60-3c1ed805e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1354658554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d7ae6-0bc8-4c78-a894-7d2c3706358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a07dd5a2df45899a89ae47e6ade7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:03Z,use_quota=True,user_id='2fc05ef8caf1498fb9887e749a4481b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc253ff6-d1bd-45dc-b8e5-3337b3070d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc253ff6-d1bd-45dc-b8e5-3337b3070d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c06415d-e935-4ada-933c-5405676348f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c06415d-e935-4ada-933c-5405676348f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '773d7ae6-0bc8-4c78-a894-7d2c3706358c', 'volume_name': 'volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e8d7cd-6a27-49f1-a61a-2d799ca99c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e8d7cd-6a27-49f1-a61a-2d799ca99c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af49529-d88c-46bb-b915-9c939bfd6fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:03 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Volume 773d7ae6-0bc8-4c78-a894-7d2c3706358c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c', 'volume_size': 1} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1354658554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773d7ae6-0bc8-4c78-a894-7d2c3706358c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a07dd5a2df45899a89ae47e6ade7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:20:03Z,use_quota=True,user_id='2fc05ef8caf1498fb9887e749a4481b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Creating volume 773d7ae6-0bc8-4c78-a894-7d2c3706358c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:20:03 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:20:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:03 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c 1073741824 Jun 15 07:20:03 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:04 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c 1073741824" returned: 0 in 1.702s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:05 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c Jun 15 07:20:05 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:05 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c" returned: 0 in 0.961s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] <== create_volume: return (2737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.742s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af49529-d88c-46bb-b915-9c939bfd6fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d1972c-3af5-4aa5-a3c1-3315c9d66fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:20:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Volume volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c (773d7ae6-0bc8-4c78-a894-7d2c3706358c): created successfully Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d1972c-3af5-4aa5-a3c1-3315c9d66fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:20:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Flow 'volume_create_manager' (3c8e3ac6-6120-42ab-b511-56014ef060bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:20:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a08560cf-99db-4be5-a16a-e281e96647ca tempest-DeleteServersTestJSON-361437757 None] Created volume successfully. Jun 15 07:20:13 devstack cinder-volume[91865]: WARNING py.warnings [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 15 07:20:13 devstack cinder-volume[91865]: .first() Jun 15 07:20:13 devstack cinder-volume[91865]: Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b4871-2ad4-4e8c-a1f9-0ba50a27ed05]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:13 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c Jun 15 07:20:13 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:13 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c" returned: 0 in 0.758s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc6d6fea-1787-4625-9fc0-a171cf1926db', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:20:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-d48cdac3-3db1-4b00-b1f3-e24e8847406c req-dd2c1ea1-1abe-4ce3-bccd-1b630a5cd416 tempest-DeleteServersTestJSON-361437757 None] attachment_update completed successfully. Jun 15 07:20:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8ceec6-7591-4863-a627-2bfcf748126b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:20 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a Jun 15 07:20:20 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:21 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a" returned: 0 in 1.532s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.583s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02275d33-94b1-401b-9784-d52f4cc95163', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:20:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-d4a212e9-8100-45b7-9978-e67c0c41b89a req-89850c55-0125-4e6f-afe8-64e5d70c6017 tempest-TaggedAttachmentsTest-389687830 None] attachment_update completed successfully. Jun 15 07:20:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-e9c35836-a7c5-4f0e-9a8f-f44568691c9a req-c2289e53-7c1b-4bc3-8c67-d08e65207828 tempest-DeleteServersTestJSON-361437757 None] Terminate volume connection completed successfully. Jun 15 07:20:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-e9c35836-a7c5-4f0e-9a8f-f44568691c9a req-c2289e53-7c1b-4bc3-8c67-d08e65207828 tempest-DeleteServersTestJSON-361437757 None] Deleting attachment dc6d6fea-1787-4625-9fc0-a171cf1926db. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:20:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-8e5036ee-0259-4f44-a005-fb387a6c0d02 req-28bd33a4-2170-4e7b-9b01-c05087f50ad8 tempest-TaggedAttachmentsTest-389687830 None] Terminate volume connection completed successfully. Jun 15 07:20:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-8e5036ee-0259-4f44-a005-fb387a6c0d02 req-28bd33a4-2170-4e7b-9b01-c05087f50ad8 tempest-TaggedAttachmentsTest-389687830 None] Deleting attachment 02275d33-94b1-401b-9784-d52f4cc95163. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "cinder-773d7ae6-0bc8-4c78-a894-7d2c3706358c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "cinder-773d7ae6-0bc8-4c78-a894-7d2c3706358c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "cinder-quobyte-773d7ae6-0bc8-4c78-a894-7d2c3706358c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "cinder-quobyte-773d7ae6-0bc8-4c78-a894-7d2c3706358c" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b128f6-46e0-4a41-a738-617b1dd86326]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:29 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c Jun 15 07:20:29 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:30 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c" returned: 0 in 0.815s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:30 devstack sudo[94293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c Jun 15 07:20:30 devstack sudo[94293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:30 devstack sudo[94293]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-773d7ae6-0bc8-4c78-a894-7d2c3706358c" returned: 0 in 0.621s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "cinder-quobyte-773d7ae6-0bc8-4c78-a894-7d2c3706358c" released by "delete_volume" :: held 1.489s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Created reservations ['70204b4f-e1f5-4b3b-8968-d405a0fa747f', '88802616-bdc0-45c4-be4b-87659db47511', '364c94c7-9836-4ac7-89c2-83a8768144f0', '5a3384a9-01b9-4072-a3e7-cd48f76b3632'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:30 devstack sudo[94296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:20:30 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:31 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:31 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Deleted volume successfully. Jun 15 07:20:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83880605-bcbd-4553-87fd-85e262ace60b tempest-DeleteServersTestJSON-361437757 None] Lock "cinder-773d7ae6-0bc8-4c78-a894-7d2c3706358c-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:40 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=22,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:20:41 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:20:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[664168f3-d38f-4866-97d1-3ada2b4a5555]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:45 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 Jun 15 07:20:45 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:46 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674" returned: 0 in 1.223s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.258s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-f588e116-2139-4ba1-80e3-0abc5c702674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f4c82ee-dd12-4c85-87b1-17df92966002', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:20:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-a94ec878-55b4-44ee-b8d8-129e704bf37d req-ec0348d6-f430-4a84-8605-6cbce583c511 tempest-ServerActionsTestOtherA-425211984 None] attachment_update completed successfully. Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:46 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:20:46 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:47 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.069s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:20:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:20:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "cinder-46d40793-b6a2-43c0-a8f5-eb3946d9195a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "cinder-46d40793-b6a2-43c0-a8f5-eb3946d9195a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "cinder-quobyte-46d40793-b6a2-43c0-a8f5-eb3946d9195a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "cinder-quobyte-46d40793-b6a2-43c0-a8f5-eb3946d9195a" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16407ad-5aaf-4cf3-84d2-3f7765b2929a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:52 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a Jun 15 07:20:52 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:53 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a" returned: 0 in 1.126s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:53 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a Jun 15 07:20:53 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:54 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-46d40793-b6a2-43c0-a8f5-eb3946d9195a" returned: 0 in 0.991s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "cinder-quobyte-46d40793-b6a2-43c0-a8f5-eb3946d9195a" released by "delete_volume" :: held 2.173s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Created reservations ['ac3eaa5e-9f4a-46ef-b221-ce52a6a7ce49', 'dc8a12eb-5d49-4bad-bb4d-a57ea8f50e60', 'a4e1adb6-f45d-4552-a7fd-6e0b4db34335', '6e38225b-1e81-43d2-91b7-1a80311a970e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:54 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:20:54 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:55 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.669s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:55 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:20:55 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Deleted volume successfully. Jun 15 07:20:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83b49e18-d9c6-4884-840a-fe0ee0937531 tempest-TaggedAttachmentsTest-389687830 None] Lock "cinder-46d40793-b6a2-43c0-a8f5-eb3946d9195a-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:20:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-8444eb44-cfaa-4fa1-a037-052370a46fbc tempest-ServerActionsTestOtherA-425211984 None] Terminate volume connection completed successfully. Jun 15 07:20:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-8444eb44-cfaa-4fa1-a037-052370a46fbc tempest-ServerActionsTestOtherA-425211984 None] Deleting attachment 6f4c82ee-dd12-4c85-87b1-17df92966002. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:20:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:20:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:20:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea39596e-1b7b-4322-904d-669f21bfb204]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:20:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:20:58 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 Jun 15 07:20:58 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:20:59 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Jun 15 07:20:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674" returned: 0 in 0.831s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:20:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:20:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-f588e116-2139-4ba1-80e3-0abc5c702674', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b47ed7bc-164f-4535-9211-8aba9725cde8', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:20:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-bcadcf0b-407f-4775-b091-0577f3170d50 req-3d8d10a0-19ae-4add-9963-9ada7e7e91c0 tempest-ServerActionsTestOtherA-425211984 None] attachment_update completed successfully. Jun 15 07:21:09 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:09 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (2483fe9b-0122-4012-95a6-4bc898c7c2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2360384-d1bb-48a6-a50c-ea422aa59e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2360384-d1bb-48a6-a50c-ea422aa59e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-949473123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:10Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8409f12-b06b-4771-8354-21764cfb5ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8409f12-b06b-4771-8354-21764cfb5ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1645c96-e501-493c-bf38-385cdcc8fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1645c96-e501-493c-bf38-385cdcc8fe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593', 'volume_name': 'volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1867ea-dc7c-4645-98ac-13e9c99fd3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1867ea-dc7c-4645-98ac-13e9c99fd3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6941d2f4-24b9-49c2-9fcb-d1b6c56649c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:10 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Volume eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593', 'volume_size': 1} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-949473123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:10Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Creating volume eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:10 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:21:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:10 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 1073741824 Jun 15 07:21:10 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:12 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 1073741824" returned: 0 in 1.997s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:12 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 Jun 15 07:21:12 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:13 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" returned: 0 in 1.111s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] <== create_volume: return (3283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.289s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6941d2f4-24b9-49c2-9fcb-d1b6c56649c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6679bbd-dcd0-4569-9fed-a1f5e3803380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Volume volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 (eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593): created successfully Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6679bbd-dcd0-4569-9fed-a1f5e3803380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (2483fe9b-0122-4012-95a6-4bc898c7c2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a4415763-231a-4e50-b31c-3ac05d810804 tempest-AttachVolumeNegativeTest-909968228 None] Created volume successfully. Jun 15 07:21:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:18 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3810cfe-6e3c-4db4-b52a-2e937bad228a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:18 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 Jun 15 07:21:18 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:20 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" returned: 0 in 1.912s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.971s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06b10afa-35b4-4fb1-9d91-f41f05e6434a', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:21:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-ca3b3c0b-f2be-421b-9ae2-c8ef89cb9c58 req-5ed8091d-1ef1-42dd-98c7-3064b074ecc9 tempest-AttachVolumeNegativeTest-909968228 None] attachment_update completed successfully. Jun 15 07:21:30 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:30 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Flow 'volume_create_manager' (452bc7ef-d52a-4cab-9e08-16bffa59a2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbf96cc-290d-4d8d-8cfc-e4286e11cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbf96cc-290d-4d8d-8cfc-e4286e11cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-228808706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a67903-4dae-4365-8bff-16624bee3ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69650b7ee4cc4af7bcadf55b05d41fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:34Z,use_quota=True,user_id='2c8fbbd924514f4c818d576fca6010e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2dda95-483e-42ec-b46a-ac3d0f4a2630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d2dda95-483e-42ec-b46a-ac3d0f4a2630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c9fe61-846d-4770-aad7-fd58c35b0764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c9fe61-846d-4770-aad7-fd58c35b0764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a67903-4dae-4365-8bff-16624bee3ecf', 'volume_name': 'volume-40a67903-4dae-4365-8bff-16624bee3ecf', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5c0d00-37cd-46d8-b090-1c26f93e9431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f5c0d00-37cd-46d8-b090-1c26f93e9431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079d29cd-28f4-4e4c-ab4d-0a9e6d73b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Volume 40a67903-4dae-4365-8bff-16624bee3ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a67903-4dae-4365-8bff-16624bee3ecf', 'volume_size': 1} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-228808706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a67903-4dae-4365-8bff-16624bee3ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69650b7ee4cc4af7bcadf55b05d41fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:21:34Z,use_quota=True,user_id='2c8fbbd924514f4c818d576fca6010e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Creating volume 40a67903-4dae-4365-8bff-16624bee3ecf {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:21:34 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:21:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:34 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf 1073741824 Jun 15 07:21:34 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:35 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf 1073741824" returned: 0 in 1.335s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:35 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf Jun 15 07:21:35 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:36 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf" returned: 0 in 0.978s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079d29cd-28f4-4e4c-ab4d-0a9e6d73b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a67903-4dae-4365-8bff-16624bee3ecf', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dd6c85-0b32-4573-a950-7c974a157043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:21:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Volume volume-40a67903-4dae-4365-8bff-16624bee3ecf (40a67903-4dae-4365-8bff-16624bee3ecf): created successfully Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18dd6c85-0b32-4573-a950-7c974a157043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:21:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Flow 'volume_create_manager' (452bc7ef-d52a-4cab-9e08-16bffa59a2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:21:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9070a5b3-d1ca-42a4-a56c-1cda3deb9da3 tempest-ServerRescueNegativeTestJSON-1121541151 None] Created volume successfully. Jun 15 07:21:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-f4822f6d-3128-4d24-b58d-db5c5a90bd24 req-d195ef48-11b1-44ee-bb81-3904f9690189 tempest-ServerActionsTestOtherA-425211984 None] Terminate volume connection completed successfully. Jun 15 07:21:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-f4822f6d-3128-4d24-b58d-db5c5a90bd24 req-d195ef48-11b1-44ee-bb81-3904f9690189 tempest-ServerActionsTestOtherA-425211984 None] Deleting attachment b47ed7bc-164f-4535-9211-8aba9725cde8. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:46 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:21:46 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:47 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.720s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:48 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "cinder-f588e116-2139-4ba1-80e3-0abc5c702674-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "cinder-f588e116-2139-4ba1-80e3-0abc5c702674-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "cinder-quobyte-f588e116-2139-4ba1-80e3-0abc5c702674" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "cinder-quobyte-f588e116-2139-4ba1-80e3-0abc5c702674" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[885f2168-3161-46fd-a83d-0928a29518a0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:21:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:53 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 Jun 15 07:21:53 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:54 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674" returned: 0 in 1.735s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:54 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674 Jun 15 07:21:54 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:56 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f588e116-2139-4ba1-80e3-0abc5c702674" returned: 0 in 1.401s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "cinder-quobyte-f588e116-2139-4ba1-80e3-0abc5c702674" released by "delete_volume" :: held 3.282s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Created reservations ['76c8c086-65bd-43f8-a1b3-fe5aa2b4e0de', 'f50e75dc-e752-4e03-aa54-2f4bd79957f0', '2e57fc2f-32e7-4ff9-b526-67a63a4648c5', '1391ca16-e254-4adf-9b2e-ecfbb6e25831'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:21:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:21:56 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:21:56 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:21:57 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jun 15 07:21:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.298s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:21:57 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:21:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Deleted volume successfully. Jun 15 07:21:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b27ec650-b870-4638-911d-c77ecf1c9a5b tempest-ServerActionsTestOtherA-425211984 None] Lock "cinder-f588e116-2139-4ba1-80e3-0abc5c702674-delete_volume" released by "delete_volume" :: held 5.037s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Acquiring lock "cinder-40a67903-4dae-4365-8bff-16624bee3ecf-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "cinder-40a67903-4dae-4365-8bff-16624bee3ecf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Acquiring lock "cinder-quobyte-40a67903-4dae-4365-8bff-16624bee3ecf" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "cinder-quobyte-40a67903-4dae-4365-8bff-16624bee3ecf" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb10007-9de4-48fa-ac06-a51d7de4adc4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:04 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf Jun 15 07:22:04 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:05 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf" returned: 0 in 1.507s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:05 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf Jun 15 07:22:05 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:07 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40a67903-4dae-4365-8bff-16624bee3ecf" returned: 0 in 1.931s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "cinder-quobyte-40a67903-4dae-4365-8bff-16624bee3ecf" released by "delete_volume" :: held 3.572s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Created reservations ['93696596-4df2-4b98-90b2-fea92b530f6b', 'b6d1b28a-d281-43cc-abc1-e09c8acdaa09', '18d8af91-250c-47d9-81d6-eb2203681ffe', '4ab40516-fd0e-46a7-876c-720c8ac970d3'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:08 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:22:08 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:10 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 2.228s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:10 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Deleted volume successfully. Jun 15 07:22:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-491632d7-54d9-4854-9836-1277e3f5f4df tempest-ServerRescueNegativeTestJSON-1121541151 None] Lock "cinder-40a67903-4dae-4365-8bff-16624bee3ecf-delete_volume" released by "delete_volume" :: held 6.369s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:17 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=12,cinder:UPDATE=20,cinder:INSERT=1,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:22:20 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=9,cinder:INSERT=7,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Flow 'volume_create_manager' (64c70fad-ba56-46cd-a614-69844c9c8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f9809-5155-4308-a06e-4496809de9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f9809-5155-4308-a06e-4496809de9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-842528798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a629573-c57b-42ad-8a73-af45a835e67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75647a34b4a54272889a439171a50900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:32Z,use_quota=True,user_id='2c391b4a034e4b6cb6d30092182ed4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5df541-2aac-4f86-ac53-bfe6927619f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5df541-2aac-4f86-ac53-bfe6927619f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5314c011-7d74-4ae7-9fb7-39dd0886732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5314c011-7d74-4ae7-9fb7-39dd0886732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a629573-c57b-42ad-8a73-af45a835e67e', 'volume_name': 'volume-5a629573-c57b-42ad-8a73-af45a835e67e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd0ed4-bdeb-4ef6-a9fa-e67a48608e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebd0ed4-bdeb-4ef6-a9fa-e67a48608e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e63db-75fe-4939-a356-7c624df96619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Volume 5a629573-c57b-42ad-8a73-af45a835e67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a629573-c57b-42ad-8a73-af45a835e67e', 'volume_size': 1} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-842528798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a629573-c57b-42ad-8a73-af45a835e67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75647a34b4a54272889a439171a50900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:32Z,use_quota=True,user_id='2c391b4a034e4b6cb6d30092182ed4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Creating volume 5a629573-c57b-42ad-8a73-af45a835e67e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:32 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:22:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:32 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e 1073741824 Jun 15 07:22:32 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:33 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e 1073741824" returned: 0 in 1.118s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:33 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e Jun 15 07:22:33 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:34 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589e63db-75fe-4939-a356-7c624df96619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a629573-c57b-42ad-8a73-af45a835e67e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19392719-4e0f-4cec-95d5-8d2a1c7dcee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Volume volume-5a629573-c57b-42ad-8a73-af45a835e67e (5a629573-c57b-42ad-8a73-af45a835e67e): created successfully Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19392719-4e0f-4cec-95d5-8d2a1c7dcee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Flow 'volume_create_manager' (64c70fad-ba56-46cd-a614-69844c9c8f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d45aac19-4cab-4ca7-ab99-19fd212edbc0 tempest-ServersNegativeTestJSON-1184081115 None] Created volume successfully. Jun 15 07:22:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-ab82fbba-0c3b-42db-a75f-3fd43f728343 req-638cc04a-c832-4086-b2bf-2db2e60482dc tempest-AttachVolumeNegativeTest-909968228 None] Terminate volume connection completed successfully. Jun 15 07:22:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ab82fbba-0c3b-42db-a75f-3fd43f728343 req-638cc04a-c832-4086-b2bf-2db2e60482dc tempest-AttachVolumeNegativeTest-909968228 None] Deleting attachment 06b10afa-35b4-4fb1-9d91-f41f05e6434a. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Flow 'volume_create_manager' (60b7eb2d-7d35-47c6-91d7-72516ec21b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74732d-997e-476c-92e1-9c9d1aa5c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74732d-997e-476c-92e1-9c9d1aa5c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1092218901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50722738-5e4a-458c-bcba-1dd2b9bce50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75647a34b4a54272889a439171a50900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:38Z,use_quota=True,user_id='2c391b4a034e4b6cb6d30092182ed4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0458ed8-0468-46d2-929f-249042dafe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0458ed8-0468-46d2-929f-249042dafe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345c4173-b7f4-4593-aa1e-58dd53273aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345c4173-b7f4-4593-aa1e-58dd53273aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50722738-5e4a-458c-bcba-1dd2b9bce50e', 'volume_name': 'volume-50722738-5e4a-458c-bcba-1dd2b9bce50e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69477d73-a974-467a-b574-7efc91a6821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69477d73-a974-467a-b574-7efc91a6821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26165c11-ea23-4524-830f-9fa3ddaf5240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:38 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Volume 50722738-5e4a-458c-bcba-1dd2b9bce50e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50722738-5e4a-458c-bcba-1dd2b9bce50e', 'volume_size': 1} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1092218901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50722738-5e4a-458c-bcba-1dd2b9bce50e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75647a34b4a54272889a439171a50900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:22:38Z,use_quota=True,user_id='2c391b4a034e4b6cb6d30092182ed4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Creating volume 50722738-5e4a-458c-bcba-1dd2b9bce50e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:22:38 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:38 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e 1073741824 Jun 15 07:22:38 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:38 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e 1073741824" returned: 0 in 0.937s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:39 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e Jun 15 07:22:39 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:39 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e" returned: 0 in 0.623s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26165c11-ea23-4524-830f-9fa3ddaf5240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50722738-5e4a-458c-bcba-1dd2b9bce50e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef76fe-b81d-466c-962e-44422f563ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:22:39 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Volume volume-50722738-5e4a-458c-bcba-1dd2b9bce50e (50722738-5e4a-458c-bcba-1dd2b9bce50e): created successfully Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ef76fe-b81d-466c-962e-44422f563ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:22:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Flow 'volume_create_manager' (60b7eb2d-7d35-47c6-91d7-72516ec21b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:22:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1828a148-2093-4585-b8aa-ab6b09fb1777 tempest-ServersNegativeTestJSON-1184081115 None] Created volume successfully. Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "cinder-50722738-5e4a-458c-bcba-1dd2b9bce50e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-50722738-5e4a-458c-bcba-1dd2b9bce50e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "cinder-quobyte-50722738-5e4a-458c-bcba-1dd2b9bce50e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-quobyte-50722738-5e4a-458c-bcba-1dd2b9bce50e" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b1a36-2ac4-4a31-b8d8-e2d2020c5f7b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:41 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e Jun 15 07:22:41 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:42 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e" returned: 0 in 0.793s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:42 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e Jun 15 07:22:42 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:43 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50722738-5e4a-458c-bcba-1dd2b9bce50e" returned: 0 in 0.795s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-quobyte-50722738-5e4a-458c-bcba-1dd2b9bce50e" released by "delete_volume" :: held 1.641s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Created reservations ['9eb3d14c-642b-437f-9962-cd05f6a428b6', '74917268-0d1c-4b74-bfbc-036d98ac9960', '04bddaf3-74ec-420e-b222-390be11fc47b', '8c88c199-8698-4921-bcf4-82eac5cf2fd9'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:43 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:22:43 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "cinder-5a629573-c57b-42ad-8a73-af45a835e67e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-5a629573-c57b-42ad-8a73-af45a835e67e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "cinder-quobyte-5a629573-c57b-42ad-8a73-af45a835e67e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-quobyte-5a629573-c57b-42ad-8a73-af45a835e67e" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e9e9a2-9dab-49d2-8fe5-69a0f6de1b0f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:22:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:44 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e Jun 15 07:22:44 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:44 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.927s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:44 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Deleted volume successfully. Jun 15 07:22:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-bb0b1099-6c77-4b16-bd1d-df214642127e tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-50722738-5e4a-458c-bcba-1dd2b9bce50e-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:44 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e" returned: 0 in 1.076s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:44 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e Jun 15 07:22:44 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:45 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a629573-c57b-42ad-8a73-af45a835e67e" returned: 0 in 0.773s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-quobyte-5a629573-c57b-42ad-8a73-af45a835e67e" released by "delete_volume" :: held 1.924s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Created reservations ['0f25d3d7-563a-4351-829c-8b9c51863aa5', '9b98293c-d79a-4a3d-9d9a-9a24054d51ac', '7fc7e383-39a3-4eae-ae31-6b0bf82d5939', '464a3983-5ee2-4319-b16d-374e68550113'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:45 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:22:45 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:22:46 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:22:46 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:22:46 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.788s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Deleted volume successfully. Jun 15 07:22:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-caef78e2-9b9b-4288-971d-e1ac241953bc tempest-ServersNegativeTestJSON-1184081115 None] Lock "cinder-5a629573-c57b-42ad-8a73-af45a835e67e-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:22:47 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 15 07:22:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.732s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:22:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:22:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:22:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:22:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:22:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=18,cinder:UPDATE=23,cinder:INSERT=4 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:22:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=6,cinder:DELETE=4 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:23:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89319d58-998f-4714-8db9-63639452365c tempest-BackendsCapabilitiesAdminTestsJSON-1006881713 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548751831055, 'free_capacity_gb': 1775.7548751831055, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91865) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 15 07:23:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a0d498f-6249-4c69-80f4-579cd4976761 tempest-BackendsCapabilitiesAdminTestsJSON-1006881713 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7548751831055, 'free_capacity_gb': 1775.7548751831055, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91865) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Flow 'volume_create_manager' (67de71ef-a97b-4d07-ba6b-5a223ef47b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8b1649-ea8e-49ab-adcd-3ce587692a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8b1649-ea8e-49ab-adcd-3ce587692a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-441354051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3d476c-c5db-47c1-935c-d65f5615d7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc96ea85ec454a8fb1cd1fbc76b8ff13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:23Z,use_quota=True,user_id='d01c66c195da442e97d446d2455da2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64734dfb-b61c-4b30-bc70-6b614898ad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64734dfb-b61c-4b30-bc70-6b614898ad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd53284a-7695-42d9-a92b-e283105e3bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd53284a-7695-42d9-a92b-e283105e3bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3d476c-c5db-47c1-935c-d65f5615d7c3', 'volume_name': 'volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64b8d51-06aa-4fa0-b6c8-c8a9fc530cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64b8d51-06aa-4fa0-b6c8-c8a9fc530cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f279514-5c80-4829-a4a4-830abc8f1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:23 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3', 'volume_size': 1} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-441354051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3d476c-c5db-47c1-935c-d65f5615d7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc96ea85ec454a8fb1cd1fbc76b8ff13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:23Z,use_quota=True,user_id='d01c66c195da442e97d446d2455da2b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Creating volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:23 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:23:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:23 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 1073741824 Jun 15 07:23:23 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Flow 'volume_create_manager' (22d18f6e-a35a-47f4-bac1-0203a0bca6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe2dbe0-755e-4a3e-b9ff-b3b73d41dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe2dbe0-755e-4a3e-b9ff-b3b73d41dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1924782368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efc4eb6-01ed-4240-864f-91e5550571c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061f3ab809c45ee8a46f9dca5adad0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:24Z,use_quota=True,user_id='3b564522175f4a0281de1c7a64c400b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d115959-16e3-4f90-a794-c40684800cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d115959-16e3-4f90-a794-c40684800cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8ac98d-7b94-43d4-ac6d-217b6fe1a482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8ac98d-7b94-43d4-ac6d-217b6fe1a482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efc4eb6-01ed-4240-864f-91e5550571c2', 'volume_name': 'volume-7efc4eb6-01ed-4240-864f-91e5550571c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a51a8d-0ed2-480c-a8e2-dc5dc1fc1427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a51a8d-0ed2-480c-a8e2-dc5dc1fc1427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6135b15-76da-4bd9-8dcd-003f84f66e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume 7efc4eb6-01ed-4240-864f-91e5550571c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efc4eb6-01ed-4240-864f-91e5550571c2', 'volume_size': 1} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:24 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 1073741824" returned: 0 in 1.020s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:24 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 Jun 15 07:23:24 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:25 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3" returned: 0 in 0.658s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1924782368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efc4eb6-01ed-4240-864f-91e5550571c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061f3ab809c45ee8a46f9dca5adad0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:24Z,use_quota=True,user_id='3b564522175f4a0281de1c7a64c400b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Creating volume 7efc4eb6-01ed-4240-864f-91e5550571c2 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:25 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f279514-5c80-4829-a4a4-830abc8f1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 1073741824 Jun 15 07:23:25 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4afa38-865a-4883-bd73-75846b26cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:25 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Volume volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 (7e3d476c-c5db-47c1-935c-d65f5615d7c3): created successfully Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4afa38-865a-4883-bd73-75846b26cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Flow 'volume_create_manager' (67de71ef-a97b-4d07-ba6b-5a223ef47b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8206ae73-de25-4d14-a891-9a5cdf0dbda5 tempest-SnapshotsActionsTest-567635713 None] Created volume successfully. Jun 15 07:23:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:26 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 1073741824" returned: 0 in 0.836s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:26 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 Jun 15 07:23:26 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:26 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2" returned: 0 in 0.583s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.868s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6135b15-76da-4bd9-8dcd-003f84f66e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efc4eb6-01ed-4240-864f-91e5550571c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323be28-ed71-4d81-aa59-a198a595b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Creating offline snapshot cf81be33-c981-484a-9284-a763105a02a9 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:26 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume volume-7efc4eb6-01ed-4240-864f-91e5550571c2 (7efc4eb6-01ed-4240-864f-91e5550571c2): created successfully Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6323be28-ed71-4d81-aa59-a198a595b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Flow 'volume_create_manager' (22d18f6e-a35a-47f4-bac1-0203a0bca6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[465d3432-164b-4bdb-9a12-c36563c1546a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c54ffa70-65a4-4271-97e1-10f8c1f149d7 tempest-AttachVolumeShelveTestJSON-750972458 None] Created volume successfully. Jun 15 07:23:26 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 Jun 15 07:23:26 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:27 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3" returned: 0 in 0.724s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:27 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 1G Jun 15 07:23:27 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:28 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 1G" returned: 0 in 0.808s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:28 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:28 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:28 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.680s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:28 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 is being set with open permissions: ugo+rw Jun 15 07:23:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:29 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:29 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:29 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.692s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:29 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info Jun 15 07:23:29 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:30 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info" returned: 0 in 0.834s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:30 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info is being set with open permissions: ugo+rw Jun 15 07:23:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:30 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info Jun 15 07:23:30 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:31 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.info" returned: 0 in 0.668s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.533s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8ab20863-3d15-4d51-86d1-41fd17ec5ee5 tempest-SnapshotsActionsTest-567635713 None] Create snapshot completed successfully Jun 15 07:23:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Creating offline snapshot a72dd3d7-42ad-4f86-b2e0-fbee77347f9c of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0eec91-3c6f-4f06-adab-ddb7430d485e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:32 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:32 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:33 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.836s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:33 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c 1G Jun 15 07:23:33 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:34 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c 1G" returned: 0 in 0.864s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:34 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c Jun 15 07:23:34 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:35 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" returned: 0 in 0.743s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:35 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c is being set with open permissions: ugo+rw Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:35 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c Jun 15 07:23:35 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (76216edf-2990-471b-8282-8df925184720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2f2e99-1ca1-4d94-938a-a9745109db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f2f2e99-1ca1-4d94-938a-a9745109db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911020826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782c5054-fd97-461f-8170-c67d97217b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:35Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca63131-bde3-4935-adca-e4803b754adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca63131-bde3-4935-adca-e4803b754adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b997872-b494-4c83-a855-1d0bf84306f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b997872-b494-4c83-a855-1d0bf84306f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782c5054-fd97-461f-8170-c67d97217b10', 'volume_name': 'volume-782c5054-fd97-461f-8170-c67d97217b10', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4d9b3-47b8-43d1-954c-1690bbe4d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b4d9b3-47b8-43d1-954c-1690bbe4d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57e6733-0baf-40e3-9855-75f4a9bb3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:35 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Volume 782c5054-fd97-461f-8170-c67d97217b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782c5054-fd97-461f-8170-c67d97217b10', 'volume_size': 1} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:35 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-911020826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782c5054-fd97-461f-8170-c67d97217b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:35Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Creating volume 782c5054-fd97-461f-8170-c67d97217b10 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:35 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:23:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:35 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 1073741824 Jun 15 07:23:35 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f5b2f506-38be-4ab7-b495-6f00a0817cba tempest-SnapshotsActionsTest-567635713 None] Create snapshot completed successfully Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (2aafacbe-c15f-4f8b-bf09-69a3a50ddd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0acc9-80f4-4bc1-bc1e-f6e2b1acb517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c0acc9-80f4-4bc1-bc1e-f6e2b1acb517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1503873014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a3e2a6-a63f-4363-beff-d5a7d5f9342a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:37Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfc4f15-67a1-4ad2-9fa5-2b33bb3eca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebfc4f15-67a1-4ad2-9fa5-2b33bb3eca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c4ed6e-177b-40c0-aa36-e3c813c3f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c4ed6e-177b-40c0-aa36-e3c813c3f14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a3e2a6-a63f-4363-beff-d5a7d5f9342a', 'volume_name': 'volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9ab5c-7234-4e50-84c9-02b4cf4e95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a9ab5c-7234-4e50-84c9-02b4cf4e95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:36 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0067b3-cb6e-4415-b155-741a0a602ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Volume a1a3e2a6-a63f-4363-beff-d5a7d5f9342a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a', 'volume_size': 1} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 1073741824" returned: 0 in 0.958s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:36 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 Jun 15 07:23:36 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Deleting offline snapshot a72dd3d7-42ad-4f86-b2e0-fbee77347f9c of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] snapshot_file for this snap is: volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ccfd0b-9092-44cc-aa7d-eb8ebed8c500]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:37 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c Jun 15 07:23:37 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:37 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10" returned: 0 in 0.661s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1503873014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a3e2a6-a63f-4363-beff-d5a7d5f9342a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:23:37Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Creating volume a1a3e2a6-a63f-4363-beff-d5a7d5f9342a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:23:37 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57e6733-0baf-40e3-9855-75f4a9bb3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782c5054-fd97-461f-8170-c67d97217b10', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:37 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a 1073741824 Jun 15 07:23:37 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f412b2-e689-4334-9b80-2204f9d1bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Volume volume-782c5054-fd97-461f-8170-c67d97217b10 (782c5054-fd97-461f-8170-c67d97217b10): created successfully Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f412b2-e689-4334-9b80-2204f9d1bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (76216edf-2990-471b-8282-8df925184720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-25735508-72d6-4e73-a6ae-e931e3198d68 tempest-AttachVolumeNegativeTest-909968228 None] Created volume successfully. Jun 15 07:23:37 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" returned: 0 in 0.724s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[83158fd3-fd77-480d-b30e-687594a083bb]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:37 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:37 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:38 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a 1073741824" returned: 0 in 0.897s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:38 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a Jun 15 07:23:38 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:38 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.711s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:38 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c Jun 15 07:23:38 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:39 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" returned: 0 in 0.653s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0067b3-cb6e-4415-b155-741a0a602ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900d183-061d-4e20-adfd-594c7e7da26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:23:39 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Volume volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a (a1a3e2a6-a63f-4363-beff-d5a7d5f9342a): created successfully Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900d183-061d-4e20-adfd-594c7e7da26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (2aafacbe-c15f-4f8b-bf09-69a3a50ddd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:23:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b87d5d1a-5fcb-4d69-9463-8304b968f667 tempest-AttachVolumeTestJSON-803141174 None] Created volume successfully. Jun 15 07:23:39 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" returned: 0 in 0.786s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:39 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c Jun 15 07:23:39 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:39 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" returned: 0 in 0.622s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c" released by "_delete_snapshot" :: held 2.955s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_snapshot" :: held 2.984s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:39 devstack cinder-volume[91865]: WARNING cinder.quota [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:23:39 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Created reservations ['da66a6e1-0807-4bba-8bf9-476f36e47027', 'f9be8e2f-a827-42c4-a762-7e2c16419a9e', 'a5dd1e38-15d1-462d-ac9a-bf594e96bb92', '8981609b-92e2-4da9-a104-327584c0a239'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:40 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Delete snapshot completed successfully. Jun 15 07:23:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e72f7292-b88e-4bfb-9b53-0f18705b6c90 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-a72dd3d7-42ad-4f86-b2e0-fbee77347f9c-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Creating offline snapshot 05852df1-9c65-4315-b538-29640d2ad0f2 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caa5e48-e6c1-4678-acd2-3d0b6b887d00]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:41 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:41 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:42 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.798s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:42 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 1G Jun 15 07:23:42 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:43 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 1G" returned: 0 in 0.855s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:43 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 Jun 15 07:23:43 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:43 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2" returned: 0 in 0.628s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:43 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 is being set with open permissions: ugo+rw Jun 15 07:23:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:43 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 Jun 15 07:23:43 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:44 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2" returned: 0 in 0.565s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.957s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.683s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5be9260-e3e3-4c96-94ea-b924b2209415]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-26826b7c-42bf-4c53-8059-3503eedf9b4a tempest-SnapshotsActionsTest-567635713 None] Create snapshot completed successfully Jun 15 07:23:44 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 Jun 15 07:23:44 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:45 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.692s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.100s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c576631-3fd1-4841-90ea-b4083f263bb2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-782c5054-fd97-461f-8170-c67d97217b10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b47ca9d-01fc-4ce4-a897-8d0488874b8b', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:23:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-e8085869-87f9-463d-a96f-f97427165172 req-dff5210b-322f-42d8-bb38-92c889c22333 tempest-AttachVolumeNegativeTest-909968228 None] attachment_update completed successfully. Jun 15 07:23:45 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a Jun 15 07:23:45 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-05852df1-9c65-4315-b538-29640d2ad0f2-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-05852df1-9c65-4315-b538-29640d2ad0f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-05852df1-9c65-4315-b538-29640d2ad0f2" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-05852df1-9c65-4315-b538-29640d2ad0f2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Deleting offline snapshot 05852df1-9c65-4315-b538-29640d2ad0f2 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:23:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] snapshot_file for this snap is: volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6347a10-e414-4a67-b1eb-91b2ff977e2f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:46 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" returned: 0 in 0.996s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:46 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 Jun 15 07:23:46 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '674d8a1b-837d-4b5e-b435-79ca8a698ad6', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:23:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-e8c25222-229f-4af3-a8d8-35dc5b8135ad req-c2cb55d5-eeb8-4501-bd19-3fdff9c11ed7 tempest-AttachVolumeTestJSON-803141174 None] attachment_update completed successfully. Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:46 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:23:46 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:46 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2" returned: 0 in 0.907s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73df580-d541-4eff-be3f-734874cb2527]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:47 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:47 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:47 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.698s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:23:47 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.783s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:47 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 Jun 15 07:23:47 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:48 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:48 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2 Jun 15 07:23:48 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:49 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.05852df1-9c65-4315-b538-29640d2ad0f2" returned: 0 in 0.688s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-05852df1-9c65-4315-b538-29640d2ad0f2" released by "_delete_snapshot" :: held 3.284s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_snapshot" :: held 3.310s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:49 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Created reservations ['2315f5a1-25ff-43af-bf89-3697016884e3', '8a050322-5a9d-4bc7-809c-b297a5fa2623', '36448b95-be8d-4edc-b5d5-6ac3d1401184', '37f0b58f-7bc7-4f96-aeab-85ad754678d1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Delete snapshot completed successfully. Jun 15 07:23:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-386d2a22-34eb-4afb-80ca-7adbae0004be tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-05852df1-9c65-4315-b538-29640d2ad0f2-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccad7b34-1c0d-497d-ac7a-7e5a38008365]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:50 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 Jun 15 07:23:50 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:50 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2" returned: 0 in 0.757s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.319s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Creating offline snapshot b418a375-5dd0-4d29-a7c4-7d4723c38f62 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f9e7c-5f92-4669-8f51-13eee090a31a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-7efc4eb6-01ed-4240-864f-91e5550571c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4828027b-6d54-4761-9d0a-81c1d70954f3', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:23:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-4bbef0ca-ac64-4ab8-96d5-667d5d7da2fc req-0bc8b1b1-2b3b-41eb-bd0e-42f26d706f6e tempest-AttachVolumeShelveTestJSON-750972458 None] attachment_update completed successfully. Jun 15 07:23:51 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:51 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:51 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.789s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:51 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 1G Jun 15 07:23:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-4bbc3312-a60c-4251-9b0b-9a56d6c69b0d req-60487f5f-8d21-4251-a896-6ebb5ecd166b tempest-AttachVolumeNegativeTest-909968228 None] Terminate volume connection completed successfully. Jun 15 07:23:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-4bbc3312-a60c-4251-9b0b-9a56d6c69b0d req-60487f5f-8d21-4251-a896-6ebb5ecd166b tempest-AttachVolumeNegativeTest-909968228 None] Deleting attachment 3b47ca9d-01fc-4ce4-a897-8d0488874b8b. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:23:51 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:52 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 1G" returned: 0 in 0.791s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:52 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 Jun 15 07:23:52 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:53 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62" returned: 0 in 0.841s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:53 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 is being set with open permissions: ugo+rw Jun 15 07:23:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:53 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 Jun 15 07:23:53 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:54 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62" returned: 0 in 0.639s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:23:54 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e28f5f68-f115-4bf2-8d2f-4ac842e1d670 tempest-SnapshotsActionsTest-567635713 None] Create snapshot completed successfully Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-b418a375-5dd0-4d29-a7c4-7d4723c38f62-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-b418a375-5dd0-4d29-a7c4-7d4723c38f62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-b418a375-5dd0-4d29-a7c4-7d4723c38f62" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-b418a375-5dd0-4d29-a7c4-7d4723c38f62" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Deleting offline snapshot b418a375-5dd0-4d29-a7c4-7d4723c38f62 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] snapshot_file for this snap is: volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850940a-fe98-4346-92bf-e9d38cbba0c6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:55 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 Jun 15 07:23:55 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:55 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62" returned: 0 in 0.935s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d26e6-95ab-48e2-aab7-91854bdb7f27]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:56 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:56 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:56 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.794s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:23:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:56 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 Jun 15 07:23:56 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:57 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:57 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62 Jun 15 07:23:57 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:23:58 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jun 15 07:23:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.b418a375-5dd0-4d29-a7c4-7d4723c38f62" returned: 0 in 0.657s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:23:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-b418a375-5dd0-4d29-a7c4-7d4723c38f62" released by "_delete_snapshot" :: held 3.358s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_snapshot" :: held 3.382s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:58 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Created reservations ['3e3dcc77-cb5e-4078-9101-e64bf5fdd60f', '49a86903-5315-4496-9eb0-f4fd5a527aa3', 'ea4c30be-d70c-42fc-a678-81c091a4c42e', 'ea8be28a-1e58-4b82-987a-bb1b2d5bda5d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:23:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Delete snapshot completed successfully. Jun 15 07:23:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f28dbdf9-cfdd-41de-a93e-037665212108 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-b418a375-5dd0-4d29-a7c4-7d4723c38f62-delete_snapshot" released by "delete_snapshot" :: held 3.535s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:23:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:23:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:23:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Creating offline snapshot e4dbe513-dc4b-42f1-91c6-42f93837cf3c of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:23:59 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[770e7f77-6ea0-4dc0-90fe-986cbbeb6d58]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:23:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:23:59 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:23:59 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:00 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.768s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:00 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c 1G Jun 15 07:24:00 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:01 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c 1G" returned: 0 in 0.899s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:01 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c Jun 15 07:24:01 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:01 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c" returned: 0 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:01 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c is being set with open permissions: ugo+rw Jun 15 07:24:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:01 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c Jun 15 07:24:01 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:02 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c" returned: 0 in 0.581s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.119s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0bc9f406-22f0-4331-97bc-e00cb5493d05 tempest-SnapshotsActionsTest-567635713 None] Create snapshot completed successfully Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-e4dbe513-dc4b-42f1-91c6-42f93837cf3c-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-e4dbe513-dc4b-42f1-91c6-42f93837cf3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Acquiring lock "cinder-quobyte-e4dbe513-dc4b-42f1-91c6-42f93837cf3c" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-e4dbe513-dc4b-42f1-91c6-42f93837cf3c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Deleting offline snapshot e4dbe513-dc4b-42f1-91c6-42f93837cf3c of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] snapshot_file for this snap is: volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533e5bd-3ed9-4694-8bd1-83b78157a2be]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:04 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c Jun 15 07:24:04 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:04 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c" returned: 0 in 0.923s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588d031-1bb2-4648-97b8-8cd8492a4353]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:05 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:24:05 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:06 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 1.198s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:06 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c Jun 15 07:24:06 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:06 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c" returned: 0 in 0.767s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:06 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c Jun 15 07:24:06 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:08 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.e4dbe513-dc4b-42f1-91c6-42f93837cf3c" returned: 0 in 1.319s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-e4dbe513-dc4b-42f1-91c6-42f93837cf3c" released by "_delete_snapshot" :: held 4.467s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_snapshot" :: held 4.514s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:08 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Created reservations ['c834114b-433b-4a5a-91ee-feb6ebd688a0', 'b8a5a985-0c43-4172-8a3f-1ab209af9a94', '473b973b-d807-422f-a7da-0ca2998c7d2b', '45b9371d-71c0-45b7-bdf6-0ddcce770e46'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Delete snapshot completed successfully. Jun 15 07:24:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a43394c-9990-4c1f-8b4d-dc99c986b793 tempest-SnapshotsActionsTest-755304078 None] Lock "cinder-e4dbe513-dc4b-42f1-91c6-42f93837cf3c-delete_snapshot" released by "delete_snapshot" :: held 4.943s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "cinder-cf81be33-c981-484a-9284-a763105a02a9-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-cf81be33-c981-484a-9284-a763105a02a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_snapshot" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "cinder-quobyte-cf81be33-c981-484a-9284-a763105a02a9" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-cf81be33-c981-484a-9284-a763105a02a9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Deleting offline snapshot cf81be33-c981-484a-9284-a763105a02a9 of volume 7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] snapshot_file for this snap is: volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dacb0a-c8da-43f0-8c26-657de3d5bc5d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:10 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:24:10 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:11 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 1.133s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:24:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[592af95a-54e4-4394-bd28-af5a6eb40b15]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:11 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 Jun 15 07:24:11 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:12 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:12 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:24:12 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:12 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.761s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:12 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9 Jun 15 07:24:12 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:13 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3.cf81be33-c981-484a-9284-a763105a02a9" returned: 0 in 0.607s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-cf81be33-c981-484a-9284-a763105a02a9" released by "_delete_snapshot" :: held 3.416s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_snapshot" :: held 3.457s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:13 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Created reservations ['70dfdf71-3e87-4b8d-8d43-6e72995ad262', 'deb420aa-a71a-4ab6-a046-48883eb453ca', 'd4dfc53e-b03b-426e-838c-9b79423a48c8', '1a96ad57-409a-4fa5-8815-f4e57b2cca28'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Delete snapshot completed successfully. Jun 15 07:24:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-45e75228-f726-4075-8ea4-0a19f32a025e tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-cf81be33-c981-484a-9284-a763105a02a9-delete_snapshot" released by "delete_snapshot" :: held 3.619s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "cinder-7e3d476c-c5db-47c1-935c-d65f5615d7c3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-7e3d476c-c5db-47c1-935c-d65f5615d7c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3fd972-f334-4695-8fb6-8b2ff7941882]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:14 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 Jun 15 07:24:14 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:15 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3" returned: 0 in 0.953s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:15 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3 Jun 15 07:24:15 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:16 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7e3d476c-c5db-47c1-935c-d65f5615d7c3" returned: 0 in 1.402s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-quobyte-7e3d476c-c5db-47c1-935c-d65f5615d7c3" released by "delete_volume" :: held 2.433s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=50,cinder:SELECT=67,cinder:INSERT=10,cinder:DELETE=6 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=63,cinder:UPDATE=51,cinder:INSERT=15,cinder:DELETE=3 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Created reservations ['967fb959-7b82-4800-bc66-a0ab4e874230', 'e26b0cae-53a8-4d86-bbe3-fc1c94bf59fa', '093dbe85-bd92-4a3c-bd73-9f76a10723d3', '0d8346ea-61b9-491d-a93b-73e325d671ae'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:17 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:24:17 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:18 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.311s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:18 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:18 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Deleted volume successfully. Jun 15 07:24:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-83237beb-59d9-45c7-82d8-ed9f0e78d589 tempest-SnapshotsActionsTest-567635713 None] Lock "cinder-7e3d476c-c5db-47c1-935c-d65f5615d7c3-delete_volume" released by "delete_volume" :: held 4.166s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:27 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:INSERT=2,cinder:UPDATE=8,cinder:SELECT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:28 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Flow 'volume_create_manager' (ee0c0579-c072-4a07-9fe6-ce17b3c47120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29225922-571a-4fff-b596-e27a2d13c3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29225922-571a-4fff-b596-e27a2d13c3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1011420795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb647e4-7517-456d-834c-ed6ed986f27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662f45b458d943549d4bd9bde551cfd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:41Z,use_quota=True,user_id='6f165db69a054d3d966b189d7be796ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801be5c9-e7be-4fbf-abf1-d2dc06524fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801be5c9-e7be-4fbf-abf1-d2dc06524fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cfa452-676d-453a-937e-1dc03ce818ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1cfa452-676d-453a-937e-1dc03ce818ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb647e4-7517-456d-834c-ed6ed986f27c', 'volume_name': 'volume-0cb647e4-7517-456d-834c-ed6ed986f27c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b464615e-e92f-49fe-b5c4-e477e214ba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b464615e-e92f-49fe-b5c4-e477e214ba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14f2575-c5c0-4cee-a0f9-efdc6292b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:41 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Volume 0cb647e4-7517-456d-834c-ed6ed986f27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb647e4-7517-456d-834c-ed6ed986f27c', 'volume_size': 1} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1011420795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb647e4-7517-456d-834c-ed6ed986f27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='662f45b458d943549d4bd9bde551cfd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:41Z,use_quota=True,user_id='6f165db69a054d3d966b189d7be796ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Creating volume 0cb647e4-7517-456d-834c-ed6ed986f27c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:41 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:24:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:41 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c 1073741824 Jun 15 07:24:41 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:42 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c 1073741824" returned: 0 in 0.739s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:42 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c Jun 15 07:24:42 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:42 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c" returned: 0 in 0.572s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14f2575-c5c0-4cee-a0f9-efdc6292b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb647e4-7517-456d-834c-ed6ed986f27c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d024693a-030f-4bc5-b094-8896d21581aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:42 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Volume volume-0cb647e4-7517-456d-834c-ed6ed986f27c (0cb647e4-7517-456d-834c-ed6ed986f27c): created successfully Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d024693a-030f-4bc5-b094-8896d21581aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Flow 'volume_create_manager' (ee0c0579-c072-4a07-9fe6-ce17b3c47120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-61dd8035-1ff8-44ef-85ea-356012cfb944 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Created volume successfully. Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Acquiring lock "cinder-0cb647e4-7517-456d-834c-ed6ed986f27c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "cinder-0cb647e4-7517-456d-834c-ed6ed986f27c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Acquiring lock "cinder-quobyte-0cb647e4-7517-456d-834c-ed6ed986f27c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "cinder-quobyte-0cb647e4-7517-456d-834c-ed6ed986f27c" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be82e0a-410c-4bdd-839b-886e704c9888]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:44 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c Jun 15 07:24:44 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:45 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c" returned: 0 in 0.775s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:45 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c Jun 15 07:24:45 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:45 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0cb647e4-7517-456d-834c-ed6ed986f27c" returned: 0 in 0.589s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "cinder-quobyte-0cb647e4-7517-456d-834c-ed6ed986f27c" released by "delete_volume" :: held 1.402s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Created reservations ['ce906045-5c20-40b4-ba26-6b0d3f878ecd', '64cf8f0a-002d-4b58-9d41-1aaa0d03f9db', '16c6c716-4d70-4ed3-8a21-ab352346d575', '0d212cfb-b4e9-4e16-bd49-aee1138d6858'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:45 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:24:45 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-bb378d92-c770-429c-b6d7-81c91a210b29 req-53cb23a5-1b6b-4d1e-96f6-a8de5eca80d6 tempest-AttachVolumeTestJSON-803141174 None] Terminate volume connection completed successfully. Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bb378d92-c770-429c-b6d7-81c91a210b29 req-53cb23a5-1b6b-4d1e-96f6-a8de5eca80d6 tempest-AttachVolumeTestJSON-803141174 None] Deleting attachment 674d8a1b-837d-4b5e-b435-79ca8a698ad6. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:24:46 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:24:46 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:46 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.724s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Deleted volume successfully. Jun 15 07:24:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54095005-d4d1-4db7-9cd9-fe88aa354856 tempest-VolumeQuotasNegativeTestJSON-1214124247 None] Lock "cinder-0cb647e4-7517-456d-834c-ed6ed986f27c-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:24:47 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.696s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:24:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:24:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:24:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:24:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-2e15fad9-942d-4682-b835-f652a33253a3 req-5a372d96-ddd3-43d5-bdf1-44a0972e5045 tempest-AttachVolumeShelveTestJSON-750972458 None] Terminate volume connection completed successfully. Jun 15 07:24:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-2e15fad9-942d-4682-b835-f652a33253a3 req-5a372d96-ddd3-43d5-bdf1-44a0972e5045 tempest-AttachVolumeShelveTestJSON-750972458 None] Deleting attachment 4828027b-6d54-4761-9d0a-81c1d70954f3. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (30a18676-8821-49e0-a3af-20b97d44674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e13aae8-116e-4d82-a587-e6e9b664545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e13aae8-116e-4d82-a587-e6e9b664545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1640476109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1299cb6-ef65-42f3-940f-1416db28c608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:50Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593f1105-ffc5-40ae-b306-4395116e2d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593f1105-ffc5-40ae-b306-4395116e2d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa3059-8787-44b9-9c4b-b0eefb33051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2aa3059-8787-44b9-9c4b-b0eefb33051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1299cb6-ef65-42f3-940f-1416db28c608', 'volume_name': 'volume-e1299cb6-ef65-42f3-940f-1416db28c608', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1d1f68-109a-4fea-acc6-eef2f71d220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1d1f68-109a-4fea-acc6-eef2f71d220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34215ae8-a612-43b0-ac10-a5e9312a4dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Volume e1299cb6-ef65-42f3-940f-1416db28c608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1299cb6-ef65-42f3-940f-1416db28c608', 'volume_size': 1} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1640476109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1299cb6-ef65-42f3-940f-1416db28c608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c121ee69a44aefa1b272160313823d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:50Z,use_quota=True,user_id='b88de29fefcf4e299b3b4221d13c1a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Creating volume e1299cb6-ef65-42f3-940f-1416db28c608 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:49 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:24:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:49 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 1073741824 Jun 15 07:24:49 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:50 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 1073741824" returned: 0 in 0.950s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:50 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 Jun 15 07:24:50 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:51 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608" returned: 0 in 0.632s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34215ae8-a612-43b0-ac10-a5e9312a4dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1299cb6-ef65-42f3-940f-1416db28c608', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f016d-571b-42fc-9901-2efcff546be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:51 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Volume volume-e1299cb6-ef65-42f3-940f-1416db28c608 (e1299cb6-ef65-42f3-940f-1416db28c608): created successfully Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f016d-571b-42fc-9901-2efcff546be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Flow 'volume_create_manager' (30a18676-8821-49e0-a3af-20b97d44674f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8f8cb613-37a8-4f95-b7c6-84ecf2d4b1ac tempest-AttachVolumeNegativeTest-909968228 None] Created volume successfully. Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760bbad-a3eb-4f25-8190-247ecaf06889]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:55 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 Jun 15 07:24:55 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Flow 'volume_create_manager' (a7153242-13ee-4ff7-a83c-1ebc9f18b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ff2fd-a699-4a3b-8b60-769ed486b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11ff2fd-a699-4a3b-8b60-769ed486b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1109783471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e656b79f-ec5b-4300-a8e2-c1835146c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbfe87e72749aca7619d3c8fb2bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:56Z,use_quota=True,user_id='5e7ed1d1d65d406e942737c16e9f44cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b11f30-7a76-48b2-9fe1-eae80428c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b11f30-7a76-48b2-9fe1-eae80428c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cf3fe2-4071-419f-b4dc-219a255f918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0cf3fe2-4071-419f-b4dc-219a255f918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e656b79f-ec5b-4300-a8e2-c1835146c423', 'volume_name': 'volume-e656b79f-ec5b-4300-a8e2-c1835146c423', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc59fa9-ac4a-4207-8e8d-5332df149537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc59fa9-ac4a-4207-8e8d-5332df149537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aace7e8-b35e-46b4-9169-b6918791aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:56 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Volume e656b79f-ec5b-4300-a8e2-c1835146c423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e656b79f-ec5b-4300-a8e2-c1835146c423', 'volume_size': 1} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:56 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608" returned: 0 in 0.897s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1109783471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e656b79f-ec5b-4300-a8e2-c1835146c423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbfe87e72749aca7619d3c8fb2bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:24:56Z,use_quota=True,user_id='5e7ed1d1d65d406e942737c16e9f44cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Creating volume e656b79f-ec5b-4300-a8e2-c1835146c423 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:24:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:56 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 1073741824 Jun 15 07:24:56 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-e1299cb6-ef65-42f3-940f-1416db28c608', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03bc1a8c-79f3-4af7-a282-4ab7c6b54f21', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:24:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-3c20e9bb-31fd-4e4f-9497-2dc54906ac93 req-93fe24dd-9378-46fd-bdac-ef4129db1607 tempest-AttachVolumeNegativeTest-909968228 None] attachment_update completed successfully. Jun 15 07:24:56 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 1073741824" returned: 0 in 0.883s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:24:56 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 Jun 15 07:24:56 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:24:57 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423" returned: 0 in 0.654s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aace7e8-b35e-46b4-9169-b6918791aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e656b79f-ec5b-4300-a8e2-c1835146c423', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cf0bed-5dc0-4a16-8eea-8b069a766895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:24:57 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Volume volume-e656b79f-ec5b-4300-a8e2-c1835146c423 (e656b79f-ec5b-4300-a8e2-c1835146c423): created successfully Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cf0bed-5dc0-4a16-8eea-8b069a766895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:24:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Flow 'volume_create_manager' (a7153242-13ee-4ff7-a83c-1ebc9f18b063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:24:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0937a81d-ea07-4550-8cfa-8469cf24efee tempest-VolumesTransfersV357Test-1387393469 None] Created volume successfully. Jun 15 07:24:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9935c015-ac11-494e-a1af-ca8552890597 tempest-VolumesTransfersV357Test-1925200534 None] Transfer volume completed successfully. Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "cinder-e656b79f-ec5b-4300-a8e2-c1835146c423-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-e656b79f-ec5b-4300-a8e2-c1835146c423-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "cinder-quobyte-e656b79f-ec5b-4300-a8e2-c1835146c423" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-quobyte-e656b79f-ec5b-4300-a8e2-c1835146c423" acquired by "delete_volume" :: waited 0.040s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[70256ddb-01c6-412d-abb5-263218cbba14]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:00 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 Jun 15 07:25:00 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:01 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423" returned: 0 in 0.846s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:01 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423 Jun 15 07:25:01 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:02 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e656b79f-ec5b-4300-a8e2-c1835146c423" returned: 0 in 0.956s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-quobyte-e656b79f-ec5b-4300-a8e2-c1835146c423" released by "delete_volume" :: held 1.854s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Created reservations ['0914e6a1-f09d-43f2-af22-3cc752423017', 'd6b91912-4450-475a-9eb0-81d6f1a3709c', 'fd75e66a-2241-491c-bd64-65eed7b3db97', '6612a18f-20b0-4841-9585-011f89bd10bc'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:02 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:02 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:03 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.047s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Flow 'volume_create_manager' (2bff3a3e-bde7-4ccb-a1b2-61db6635652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85a03c0-bac3-4429-893a-153d364cbef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Deleted volume successfully. Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85a03c0-bac3-4429-893a-153d364cbef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1652383157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22626cb-e951-449c-9fee-8c9613931a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbfe87e72749aca7619d3c8fb2bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:03Z,use_quota=True,user_id='5e7ed1d1d65d406e942737c16e9f44cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbfa91b-bae3-43fc-ba07-7fa937d0a311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbfa91b-bae3-43fc-ba07-7fa937d0a311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4242f5b-ee81-4895-9f45-53e2fa4d17bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4242f5b-ee81-4895-9f45-53e2fa4d17bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e22626cb-e951-449c-9fee-8c9613931a58', 'volume_name': 'volume-e22626cb-e951-449c-9fee-8c9613931a58', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fa13c3-a1a0-4cf1-ad2e-dcc768dd6aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fa13c3-a1a0-4cf1-ad2e-dcc768dd6aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224f7a94-fd18-4cd3-bbb0-29ac6a4e9c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:03 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Volume e22626cb-e951-449c-9fee-8c9613931a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e22626cb-e951-449c-9fee-8c9613931a58', 'volume_size': 1} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1652383157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e22626cb-e951-449c-9fee-8c9613931a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbfe87e72749aca7619d3c8fb2bf4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:03Z,use_quota=True,user_id='5e7ed1d1d65d406e942737c16e9f44cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Creating volume e22626cb-e951-449c-9fee-8c9613931a58 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:03 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fbaa4344-bab2-4976-8e5a-4b1baa54115b tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-e656b79f-ec5b-4300-a8e2-c1835146c423-delete_volume" released by "delete_volume" :: held 3.307s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:03 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 1073741824 Jun 15 07:25:03 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-2af7cb77-7d33-453a-b35e-f0d62dd9f29f req-1fda57e7-da63-4396-8d22-c60c81b37882 tempest-AttachVolumeNegativeTest-909968228 None] Terminate volume connection completed successfully. Jun 15 07:25:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-2af7cb77-7d33-453a-b35e-f0d62dd9f29f req-1fda57e7-da63-4396-8d22-c60c81b37882 tempest-AttachVolumeNegativeTest-909968228 None] Deleting attachment 03bc1a8c-79f3-4af7-a282-4ab7c6b54f21. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:25:04 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 1073741824" returned: 0 in 1.146s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:04 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 Jun 15 07:25:04 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:05 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58" returned: 0 in 0.644s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224f7a94-fd18-4cd3-bbb0-29ac6a4e9c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e22626cb-e951-449c-9fee-8c9613931a58', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6365682-a973-4a47-b2b2-e787149cffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:05 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Volume volume-e22626cb-e951-449c-9fee-8c9613931a58 (e22626cb-e951-449c-9fee-8c9613931a58): created successfully Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6365682-a973-4a47-b2b2-e787149cffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Flow 'volume_create_manager' (2bff3a3e-bde7-4ccb-a1b2-61db6635652f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:05 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-22050809-b4c1-425f-a78d-73f3f74a1cd7 tempest-VolumesTransfersV357Test-1387393469 None] Created volume successfully. Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "cinder-e22626cb-e951-449c-9fee-8c9613931a58-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-e22626cb-e951-449c-9fee-8c9613931a58-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "cinder-quobyte-e22626cb-e951-449c-9fee-8c9613931a58" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-quobyte-e22626cb-e951-449c-9fee-8c9613931a58" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a7fcb-a3e9-478f-a516-89f274aff3d7]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:06 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 Jun 15 07:25:06 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:07 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58" returned: 0 in 1.171s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:07 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58 Jun 15 07:25:07 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:08 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e22626cb-e951-449c-9fee-8c9613931a58" returned: 0 in 0.768s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-quobyte-e22626cb-e951-449c-9fee-8c9613931a58" released by "delete_volume" :: held 1.998s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Created reservations ['128ed93d-b9af-4b7b-ad52-4abd0fbc2b56', '0dcec3e5-b0b6-43dc-bf8f-3b8889da346d', '87602d1c-1dd4-46fe-be47-af3aef13eaf7', '9a7228d7-46b3-4c34-8bc0-64da88fc23c1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:08 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:08 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:09 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.681s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:09 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Deleted volume successfully. Jun 15 07:25:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-10eb8c66-d20e-4e2f-8a7b-de64e7d58ff1 tempest-VolumesTransfersV357Test-741544159 None] Lock "cinder-e22626cb-e951-449c-9fee-8c9613931a58-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-e1299cb6-ef65-42f3-940f-1416db28c608-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-e1299cb6-ef65-42f3-940f-1416db28c608-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-quobyte-e1299cb6-ef65-42f3-940f-1416db28c608" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-e1299cb6-ef65-42f3-940f-1416db28c608" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b51db4f-f10b-4157-91f1-6cb14ddd9a4e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:15 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 Jun 15 07:25:15 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608" returned: 0 in 0.817s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608 Jun 15 07:25:16 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:16 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e1299cb6-ef65-42f3-940f-1416db28c608" returned: 0 in 0.609s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-e1299cb6-ef65-42f3-940f-1416db28c608" released by "delete_volume" :: held 1.481s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Created reservations ['b2b8b9cd-80bb-425b-a51e-4639b5ba752b', '515f78b6-9013-459c-802d-efebde58a68d', 'fde03779-fbf3-4423-8501-3a7c6006d2b5', '0ba3fdca-afe3-4a51-9166-d1ea30bc4139'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:16 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:16 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-782c5054-fd97-461f-8170-c67d97217b10-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-782c5054-fd97-461f-8170-c67d97217b10-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-quobyte-782c5054-fd97-461f-8170-c67d97217b10" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-782c5054-fd97-461f-8170-c67d97217b10" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:17 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.702s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:17 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Deleted volume successfully. Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[011008f2-9c22-4f90-9eaf-ede6ef323801]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e093ca5a-15a4-4635-a435-72b6bb962ce3 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-e1299cb6-ef65-42f3-940f-1416db28c608-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:17 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 Jun 15 07:25:17 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:18 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:18 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10 Jun 15 07:25:18 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:19 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-782c5054-fd97-461f-8170-c67d97217b10" returned: 0 in 1.205s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-782c5054-fd97-461f-8170-c67d97217b10" released by "delete_volume" :: held 2.005s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Created reservations ['66c7b98e-6219-4684-8a9c-3928679e84df', '1d594508-45dc-4626-84a9-0244e6a4ad14', '072d2517-61bf-44ac-a205-901a38ea99dd', '8cdb2a99-f88f-4381-8c47-8707556667c5'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:19 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:19 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "cinder-quobyte-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6ea9b6-b0f1-47fb-ac54-d33ef684f693]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:20 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 Jun 15 07:25:20 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:21 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.196s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:21 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Deleted volume successfully. Jun 15 07:25:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e835229-5d2d-4d5f-8912-ca102d138992 tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-782c5054-fd97-461f-8170-c67d97217b10-delete_volume" released by "delete_volume" :: held 3.596s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:21 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" returned: 0 in 0.985s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:21 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593 Jun 15 07:25:21 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:22 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" returned: 0 in 0.893s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-quobyte-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593" released by "delete_volume" :: held 1.961s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Created reservations ['40431d43-1f33-4fda-aa95-77711a2361ca', '266cf300-efd9-4b67-ab7f-fee9af25d3c2', '1662a6d2-6275-4479-b8f9-c7f988de2a39', '250bfbb7-1805-45d9-8b6a-fbd33fd37afb'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:22 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:22 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:23 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.960s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:23 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Deleted volume successfully. Jun 15 07:25:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51640b55-da84-45c5-a4fa-4668438f972b tempest-AttachVolumeNegativeTest-909968228 None] Lock "cinder-eae84ab4-1df5-4ed1-a5ba-1b6d3de9c593-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Flow 'volume_create_manager' (e1fa4d4c-1eef-4eb3-8838-6c7841d68425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455be219-6e73-40d5-87ed-355bb3813545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455be219-6e73-40d5-87ed-355bb3813545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917349458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5773b739af45a8af91471f9a43cf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:30Z,use_quota=True,user_id='6e3f07ace497411fb55242c457c74f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7fab33-36af-4230-afda-d51764aca9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7fab33-36af-4230-afda-d51764aca9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe213aa-2da4-4b15-9058-5e32fc961395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe213aa-2da4-4b15-9058-5e32fc961395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5', 'volume_name': 'volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f5e3fb-c61f-4aa0-abcf-f261f4be2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f5e3fb-c61f-4aa0-abcf-f261f4be2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9339859-c206-4430-a4c9-17126e51faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5', 'volume_size': 1} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-917349458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5773b739af45a8af91471f9a43cf33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:30Z,use_quota=True,user_id='6e3f07ace497411fb55242c457c74f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Creating volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:30 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:25:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:30 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 1073741824 Jun 15 07:25:30 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:31 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 1073741824" returned: 0 in 1.121s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:31 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:25:31 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:32 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9339859-c206-4430-a4c9-17126e51faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d0ff97-1eb9-4434-b26b-07529c90dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Volume volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 (cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5): created successfully Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82d0ff97-1eb9-4434-b26b-07529c90dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Flow 'volume_create_manager' (e1fa4d4c-1eef-4eb3-8838-6c7841d68425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ce7907a2-9244-4258-a267-ec7468607e1a tempest-VolumesActionsTest-1584130541 None] Created volume successfully. Jun 15 07:25:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e591cc5-17c3-4456-af4d-6bbac74099dd tempest-GroupsV314Test-83296532 None] Group tempest-GroupsV314Test-Group-715573021: creating Jun 15 07:25:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e591cc5-17c3-4456-af4d-6bbac74099dd tempest-GroupsV314Test-83296532 None] Group tempest-GroupsV314Test-Group-715573021: created successfully Jun 15 07:25:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e591cc5-17c3-4456-af4d-6bbac74099dd tempest-GroupsV314Test-83296532 None] Create group completed successfully. Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Flow 'volume_create_manager' (ce9df48c-79eb-4bdf-8656-233cef4ad0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce17a518-5c43-43bf-9cef-bc2479b8b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce17a518-5c43-43bf-9cef-bc2479b8b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1494181676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be1958d-e06d-4448-a98d-318677b89898,host='devstack@QuobyteHD#QuobyteHD',id=a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eace5523762a46348b64fd41677b860d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:37Z,use_quota=True,user_id='50132ca9a18647009fb24030c082a7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(960df6af-737b-442b-bb65-c3ab5701ff65),volume_type_id=960df6af-737b-442b-bb65-c3ab5701ff65)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6574e6-7cfb-4633-8698-07d33f414807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6574e6-7cfb-4633-8698-07d33f414807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd38f6b-6e87-47e8-8757-9fd467131ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd38f6b-6e87-47e8-8757-9fd467131ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed', 'volume_name': 'volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277faec3-b472-4764-b2c1-fdeaeb3d7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (277faec3-b472-4764-b2c1-fdeaeb3d7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b48220-2a2e-4794-936b-c870155ff6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Volume a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed', 'volume_size': 1} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6be1958d-e06d-4448-a98d-318677b89898,created_at=2026-06-15T05:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1494181676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6be1958d-e06d-4448-a98d-318677b89898,host='devstack@QuobyteHD#QuobyteHD',id=a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eace5523762a46348b64fd41677b860d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:37Z,use_quota=True,user_id='50132ca9a18647009fb24030c082a7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(960df6af-737b-442b-bb65-c3ab5701ff65),volume_type_id=960df6af-737b-442b-bb65-c3ab5701ff65)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Creating volume a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:25:36 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:25:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:36 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed 1073741824 Jun 15 07:25:36 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:37 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed 1073741824" returned: 0 in 0.849s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:37 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=67,cinder:SELECT=51,cinder:INSERT=17,cinder:DELETE=3 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:25:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:37 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:25:37 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:38 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 0.680s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b48220-2a2e-4794-936b-c870155ff6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805a4d06-bfdf-442d-91a7-add2ecc7447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:38 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Volume volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed (a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed): created successfully Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805a4d06-bfdf-442d-91a7-add2ecc7447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Flow 'volume_create_manager' (ce9df48c-79eb-4bdf-8656-233cef4ad0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ca3e5ecf-0fd0-43de-94ac-125ecc21fb4d tempest-GroupsV314Test-83296532 None] Created volume successfully. Jun 15 07:25:38 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=54,cinder:UPDATE=68,cinder:DELETE=9,cinder:INSERT=13 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:25:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:40 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Cloning volume a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed to volume 8b73db2c-3e9f-479b-99cd-1454c3a6c2dc Jun 15 07:25:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Creating offline snapshot 9fefd09e-ea85-4dc3-9ca5-dabd36618670 of volume a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:25:40 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a9f634-e80e-44e5-8ae6-e9917aab5d7a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:40 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:25:40 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:41 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 0.846s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:41 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 1G Jun 15 07:25:41 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:41 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 1G" returned: 0 in 0.755s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:42 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:25:42 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:42 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 0.660s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:42 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:25:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:42 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:25:42 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:43 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 0.645s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:43 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info Jun 15 07:25:43 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:44 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info" returned: 0 in 0.780s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:44 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:44 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info Jun 15 07:25:44 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:44 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.info" returned: 0 in 0.719s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Acquiring lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] snapshot: 9fefd09e-ea85-4dc3-9ca5-dabd36618670, volume: 8b73db2c-3e9f-479b-99cd-1454c3a6c2dc, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9368137-88fb-4f97-87c5-5d3343eb4af8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Flow 'volume_create_manager' (42261fa4-86df-4c12-9b86-0004e89855c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ce8a6-93e5-4f46-9dcb-c4571e62ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47ce8a6-93e5-4f46-9dcb-c4571e62ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1578076149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5249b9f-559a-488d-b57d-431ce2d81cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061f3ab809c45ee8a46f9dca5adad0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:45Z,use_quota=True,user_id='3b564522175f4a0281de1c7a64c400b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2896815d-e39f-44a3-a06f-2f80dbc88f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2896815d-e39f-44a3-a06f-2f80dbc88f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d6ce38-01fb-4875-b403-4cbcc1c539cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d6ce38-01fb-4875-b403-4cbcc1c539cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5249b9f-559a-488d-b57d-431ce2d81cae', 'volume_name': 'volume-b5249b9f-559a-488d-b57d-431ce2d81cae', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:45 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948dadb2-5baa-4c74-a109-91edbe8a6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:45 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948dadb2-5baa-4c74-a109-91edbe8a6744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcb1826-c5be-4460-8ded-becdf6258483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:25:45 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume b5249b9f-559a-488d-b57d-431ce2d81cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5249b9f-559a-488d-b57d-431ce2d81cae', 'volume_size': 1} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:45 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 0.752s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f851c0d-099c-4a44-bc98-5500f8476ae4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:45 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:25:45 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:46 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:25:46 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:46 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 1.087s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:25:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:46 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc Jun 15 07:25:46 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:47 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.041s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:25:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:25:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 8 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:25:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:25:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59cce160-ef27-4944-9c4d-1d148030a73f tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" by "attach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59cce160-ef27-4944-9c4d-1d148030a73f tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" acquired by "attach_volume" :: waited 0.053s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-59cce160-ef27-4944-9c4d-1d148030a73f tempest-VolumesActionsTest-1584130541 None] Attaching volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 to instance b0729ce6-6dce-4feb-bc04-8ea057c24341 at mountpoint /dev/vdb on host None. Jun 15 07:25:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-59cce160-ef27-4944-9c4d-1d148030a73f tempest-VolumesActionsTest-1584130541 None] Attach volume completed successfully. Jun 15 07:25:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59cce160-ef27-4944-9c4d-1d148030a73f tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" released by "attach_volume" :: held 0.536s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f1b01c87-efef-42a5-8938-6a38ea2bf966 tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" by "detach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f1b01c87-efef-42a5-8938-6a38ea2bf966 tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:52 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f1b01c87-efef-42a5-8938-6a38ea2bf966 tempest-VolumesActionsTest-1584130541 None] Detaching volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 from instance b0729ce6-6dce-4feb-bc04-8ea057c24341. Jun 15 07:25:52 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f1b01c87-efef-42a5-8938-6a38ea2bf966 tempest-VolumesActionsTest-1584130541 None] Detach volume completed successfully. Jun 15 07:25:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f1b01c87-efef-42a5-8938-6a38ea2bf966 tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" released by "detach_volume" :: held 0.226s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:56 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" returned: 0 in 9.684s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0cb651-acdf-4004-93de-fdc502cc61d2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:56 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:25:56 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:57 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 1.150s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:57 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:25:57 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Converted 1024.00 MB image at 105.72 MB/s Jun 15 07:25:57 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:25:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:57 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc Jun 15 07:25:57 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:58 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" returned: 0 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" released by "_copy_volume_from_snapshot" :: held 13.474s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Acquiring lock "cinder-quobyte-9fefd09e-ea85-4dc3-9ca5-dabd36618670" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-9fefd09e-ea85-4dc3-9ca5-dabd36618670" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Deleting offline snapshot 9fefd09e-ea85-4dc3-9ca5-dabd36618670 of volume a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] snapshot_file for this snap is: volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c646dab2-d338-4075-bb26-8d813866509d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:58 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:25:58 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:25:59 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Jun 15 07:25:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 1.087s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:25:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:25:59 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6021b02c-9f39-4a76-93c6-25e4aa1957f9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:25:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:25:59 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:25:59 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:00 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 0.785s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:00 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:26:00 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:01 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 0.731s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:01 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670 Jun 15 07:26:01 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:01 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed.9fefd09e-ea85-4dc3-9ca5-dabd36618670" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-9fefd09e-ea85-4dc3-9ca5-dabd36618670" released by "_delete_snapshot" :: held 3.319s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.464s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.634s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1578076149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5249b9f-559a-488d-b57d-431ce2d81cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9061f3ab809c45ee8a46f9dca5adad0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:25:45Z,use_quota=True,user_id='3b564522175f4a0281de1c7a64c400b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Creating volume b5249b9f-559a-488d-b57d-431ce2d81cae {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:01 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:26:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:01 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae 1073741824 Jun 15 07:26:01 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-7d21f681-993a-4697-866c-f4f4efb5559d tempest-GroupsV314Test-83296532 None] Create group from source-group-6be1958d-e06d-4448-a98d-318677b89898 completed successfully. Jun 15 07:26:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Acquiring lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" acquired by "delete_volume" :: waited 0.046s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ba03a-b011-457f-af80-90d3165d5e6b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:02 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc Jun 15 07:26:02 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:03 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae 1073741824" returned: 0 in 1.309s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:03 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae Jun 15 07:26:03 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:03 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" returned: 0 in 0.764s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:03 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc Jun 15 07:26:03 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:03 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae" returned: 0 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcb1826-c5be-4460-8ded-becdf6258483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5249b9f-559a-488d-b57d-431ce2d81cae', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1707819-01eb-40cc-ac50-99c227df19e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Volume volume-b5249b9f-559a-488d-b57d-431ce2d81cae (b5249b9f-559a-488d-b57d-431ce2d81cae): created successfully Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1707819-01eb-40cc-ac50-99c227df19e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Flow 'volume_create_manager' (42261fa4-86df-4c12-9b86-0004e89855c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:04 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9b0996f7-7095-41c9-b831-c8c0e3256758 tempest-AttachVolumeShelveTestJSON-750972458 None] Created volume successfully. Jun 15 07:26:04 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" returned: 0 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-8b73db2c-3e9f-479b-99cd-1454c3a6c2dc" released by "delete_volume" :: held 1.587s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Created reservations ['c4a9cb3e-0bba-49d7-b4ff-14dd48c8dbe3'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:04 devstack cinder-volume[91865]: WARNING cinder.quota [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1169896293 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1169896293, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:26:04 devstack cinder-volume[91865]: WARNING cinder.quota [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1169896293 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1169896293, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Created reservations ['55cb6c73-4e7f-4d69-9945-6294593a01c7', '4d7a33ce-69bb-446e-891b-c0571c9aab32', 'b8efcaf5-c3a1-45ac-9fa1-027b48dcb7e5', '17630205-7a27-4fee-91b1-e5de5baaf760'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:04 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:26:04 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:05 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.629s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:05 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-585b03ef-f7ad-423f-90ca-2ad5a2db4a68 tempest-GroupsV314Test-83296532 None] Delete group completed successfully. Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Acquiring lock "cinder-quobyte-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" acquired by "delete_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4570b-c702-41d2-9bdb-2456aa605d80]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:05 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:26:05 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:06 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 0.723s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:06 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed Jun 15 07:26:06 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:07 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" returned: 0 in 0.821s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Lock "cinder-quobyte-a2b91819-5afd-4c5d-84b2-a7dad1c9c1ed" released by "delete_volume" :: held 1.618s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Created reservations ['05a64d0d-a0a4-4078-b2a6-7fd17b2d3c90'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Created reservations ['08fe2634-0d58-4e16-b7f4-e3ac7a3c8df8', '2a8fa22a-31b5-4e3b-8f31-637fd4daa7f3', 'b7bedb53-d1e6-4798-b621-50518bd1d679', '6a78b49c-2cf2-4892-9e14-691fbb673c07'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:07 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:26:07 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:07 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.620s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:07 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-800ea26a-749a-49ba-b79b-e7f30a89b0ce tempest-GroupsV314Test-83296532 None] Delete group completed successfully. Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Flow 'volume_create_manager' (0f14b201-622a-4bad-8f8b-e282454a36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51491837-d385-4d6e-9213-8edb362661df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51491837-d385-4d6e-9213-8edb362661df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1229625800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c034af6e-edba-4c26-b122-974f6f7bc426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5b160bd5b24d5aa3fa66133921eaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:16Z,use_quota=True,user_id='7046b7dd55b946749859d9a217dc8417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753af0a9-7950-4be6-b46a-dd0acacf860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (753af0a9-7950-4be6-b46a-dd0acacf860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff726e6c-c129-4108-8a09-edd02cc3b635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff726e6c-c129-4108-8a09-edd02cc3b635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c034af6e-edba-4c26-b122-974f6f7bc426', 'volume_name': 'volume-c034af6e-edba-4c26-b122-974f6f7bc426', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c93c7-cd91-4e55-a13a-34230a45a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309c93c7-cd91-4e55-a13a-34230a45a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a58fd3-3dd9-4c54-9576-ca24f1e77ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume c034af6e-edba-4c26-b122-974f6f7bc426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c034af6e-edba-4c26-b122-974f6f7bc426', 'volume_size': 1} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1229625800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c034af6e-edba-4c26-b122-974f6f7bc426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5b160bd5b24d5aa3fa66133921eaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:16Z,use_quota=True,user_id='7046b7dd55b946749859d9a217dc8417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Creating volume c034af6e-edba-4c26-b122-974f6f7bc426 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:15 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:26:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:15 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 1073741824 Jun 15 07:26:15 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:16 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 1073741824" returned: 0 in 1.242s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:16 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 Jun 15 07:26:16 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:17 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426" returned: 0 in 0.807s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a58fd3-3dd9-4c54-9576-ca24f1e77ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c034af6e-edba-4c26-b122-974f6f7bc426', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b5b170-ef7d-4423-8d3e-cb97944c4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:17 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume volume-c034af6e-edba-4c26-b122-974f6f7bc426 (c034af6e-edba-4c26-b122-974f6f7bc426): created successfully Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b5b170-ef7d-4423-8d3e-cb97944c4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Flow 'volume_create_manager' (0f14b201-622a-4bad-8f8b-e282454a36a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:17 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5c52b3d6-a073-4959-b3e7-53c17722e340 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Created volume successfully. Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "cinder-c034af6e-edba-4c26-b122-974f6f7bc426-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "cinder-c034af6e-edba-4c26-b122-974f6f7bc426-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "cinder-quobyte-c034af6e-edba-4c26-b122-974f6f7bc426" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "cinder-quobyte-c034af6e-edba-4c26-b122-974f6f7bc426" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75a623-0f09-4333-8b29-34c5b2719870]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:19 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 Jun 15 07:26:19 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (47816ed0-f750-4eda-ad3b-aea78c17cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e2f426-8b59-466e-aad5-57ed86f02246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e2f426-8b59-466e-aad5-57ed86f02246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-484948550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:20Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce9637c-2a14-4c87-ad47-8e5558722b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce9637c-2a14-4c87-ad47-8e5558722b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641ebeb-152e-48bc-96a4-abefd9c0752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641ebeb-152e-48bc-96a4-abefd9c0752f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d', 'volume_name': 'volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d3c801-7af7-479a-84d4-80b67ebfd170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d3c801-7af7-479a-84d4-80b67ebfd170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac4824-5a16-4601-bc73-e12b1e8f6856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:20 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Volume 6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d', 'volume_size': 1} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-484948550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:20Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Creating volume 6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:20 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:20 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b21cab5a-6fc7-4028-9e12-4670fff7c37d tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" by "attach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:20 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d 1073741824 Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426" returned: 0 in 1.256s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:20 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b21cab5a-6fc7-4028-9e12-4670fff7c37d tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" acquired by "attach_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:20 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426 Jun 15 07:26:20 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b21cab5a-6fc7-4028-9e12-4670fff7c37d tempest-VolumesActionsTest-1584130541 None] Attaching volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 to instance eb73bfad-43aa-4524-b3e6-b67ca883ccec at mountpoint /dev/vdb on host None. Jun 15 07:26:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b21cab5a-6fc7-4028-9e12-4670fff7c37d tempest-VolumesActionsTest-1584130541 None] Attach volume completed successfully. Jun 15 07:26:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b21cab5a-6fc7-4028-9e12-4670fff7c37d tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" released by "attach_volume" :: held 0.186s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20c125e7-c16c-4725-9c11-fb62c9c6b367 tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" by "detach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20c125e7-c16c-4725-9c11-fb62c9c6b367 tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-20c125e7-c16c-4725-9c11-fb62c9c6b367 tempest-VolumesActionsTest-1584130541 None] Detaching volume cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 from instance eb73bfad-43aa-4524-b3e6-b67ca883ccec. Jun 15 07:26:21 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c034af6e-edba-4c26-b122-974f6f7bc426" returned: 0 in 0.929s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "cinder-quobyte-c034af6e-edba-4c26-b122-974f6f7bc426" released by "delete_volume" :: held 2.289s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-20c125e7-c16c-4725-9c11-fb62c9c6b367 tempest-VolumesActionsTest-1584130541 None] Detach volume completed successfully. Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20c125e7-c16c-4725-9c11-fb62c9c6b367 tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Created reservations ['0c5d379e-7d11-4fb4-a1c7-1b5b9222b64a', 'e4658c00-166d-4ef4-bf7d-9abee3eaf746', '68ca53ca-f570-4524-a427-a365d8e27cf2', 'd1090cf2-5604-49f6-a4c4-4ca8b5f4365c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:21 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d 1073741824" returned: 0 in 1.191s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:21 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:26:21 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:21 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d Jun 15 07:26:21 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-c9c80498-4191-486e-8564-af05bf99e806 req-88a482fb-c3a7-4b7b-8d38-5e5c44d468cc tempest-AttachVolumeShelveTestJSON-750972458 None] No connector for attachment a0a6f2c6-b7c7-49c7-8f1e-8cebc399271f; skipping storage backend terminate_connection call. {{(pid=91865) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-c9c80498-4191-486e-8564-af05bf99e806 req-88a482fb-c3a7-4b7b-8d38-5e5c44d468cc tempest-AttachVolumeShelveTestJSON-750972458 None] Deleting attachment a0a6f2c6-b7c7-49c7-8f1e-8cebc399271f. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:26:22 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.805s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Deleted volume successfully. Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0105df1c-50d2-4d95-b104-4b0c4f4ab144 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "cinder-c034af6e-edba-4c26-b122-974f6f7bc426-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:22 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" returned: 0 in 1.007s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ac4824-5a16-4601-bc73-e12b1e8f6856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e8205-8b9d-43f5-8717-05ee724d27b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:22 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Volume volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d (6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d): created successfully Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268e8205-8b9d-43f5-8717-05ee724d27b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (47816ed0-f750-4eda-ad3b-aea78c17cb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d295acef-a238-4d99-af8b-95e32e1ca7e8 tempest-AttachVolumeTestJSON-803141174 None] Created volume successfully. Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Flow 'volume_create_manager' (ac0d42df-8ffe-4703-a85b-d361b0e1622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacaa0ca-a36b-428f-a4e8-73a13f24ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacaa0ca-a36b-428f-a4e8-73a13f24ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-790901085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f92f72a-e753-4f84-849a-3d0a67703854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5b160bd5b24d5aa3fa66133921eaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:23Z,use_quota=True,user_id='7046b7dd55b946749859d9a217dc8417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31a16f4-9ac3-4b3c-a9d5-a8f41bc9793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31a16f4-9ac3-4b3c-a9d5-a8f41bc9793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502127cc-0374-4935-86be-e2e63e8ea053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502127cc-0374-4935-86be-e2e63e8ea053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f92f72a-e753-4f84-849a-3d0a67703854', 'volume_name': 'volume-4f92f72a-e753-4f84-849a-3d0a67703854', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e6193-3dbe-4c90-81ab-928dd23ac1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (489e6193-3dbe-4c90-81ab-928dd23ac1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d25201e-799a-4734-9201-6197d98f5bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:23 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume 4f92f72a-e753-4f84-849a-3d0a67703854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f92f72a-e753-4f84-849a-3d0a67703854', 'volume_size': 1} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-790901085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f92f72a-e753-4f84-849a-3d0a67703854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5b160bd5b24d5aa3fa66133921eaab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:23Z,use_quota=True,user_id='7046b7dd55b946749859d9a217dc8417',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Creating volume 4f92f72a-e753-4f84-849a-3d0a67703854 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:23 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:26:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:23 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 1073741824 Jun 15 07:26:23 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:24 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 1073741824" returned: 0 in 1.132s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:24 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 Jun 15 07:26:24 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:25 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854" returned: 0 in 0.653s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d25201e-799a-4734-9201-6197d98f5bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f92f72a-e753-4f84-849a-3d0a67703854', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb178f4a-fea1-4c99-ac0b-5dbd291380e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:25 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Volume volume-4f92f72a-e753-4f84-849a-3d0a67703854 (4f92f72a-e753-4f84-849a-3d0a67703854): created successfully Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb178f4a-fea1-4c99-ac0b-5dbd291380e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Flow 'volume_create_manager' (ac0d42df-8ffe-4703-a85b-d361b0e1622c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1a6abba9-b40f-4753-9351-742f18eb1c06 tempest-VolumeQuotasAdminTestJSON-1894755683 None] Created volume successfully. Jun 15 07:26:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ed685-8a98-49d2-a3c0-a1483868fbac]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ed7ab298-9b02-4c38-bac7-bc71ebbee760 tempest-VolumeQuotasAdminTestJSON-138904336 None] Transfer volume completed successfully. Jun 15 07:26:27 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d Jun 15 07:26:27 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:27 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" returned: 0 in 0.857s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89a01961-b4f8-44b3-b756-cbc277d51928', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:26:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-3a6b9370-cf0d-4b04-a5f0-3c2af6f49912 req-d0b001f6-7e19-4e5f-89df-50a8d86f55c7 tempest-AttachVolumeTestJSON-803141174 None] attachment_update completed successfully. Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Acquiring lock "cinder-4f92f72a-e753-4f84-849a-3d0a67703854-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "cinder-4f92f72a-e753-4f84-849a-3d0a67703854-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Acquiring lock "cinder-quobyte-4f92f72a-e753-4f84-849a-3d0a67703854" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "cinder-quobyte-4f92f72a-e753-4f84-849a-3d0a67703854" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[41256681-576b-486a-9304-fde66a9278a6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:28 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 Jun 15 07:26:28 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:29 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854" returned: 0 in 0.932s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:29 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854 Jun 15 07:26:29 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:29 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f92f72a-e753-4f84-849a-3d0a67703854" returned: 0 in 0.760s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "cinder-quobyte-4f92f72a-e753-4f84-849a-3d0a67703854" released by "delete_volume" :: held 1.758s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Created reservations ['724a8a92-09c1-478a-baa4-c08e59ed6fe5', '20be2afe-aecd-4010-9d4f-a5e599772a03', '7762e824-1608-4265-a122-294afa1b0a88', '55783d05-67bf-4515-943f-5d406e6b7a7c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:30 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:26:30 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:30 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.701s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Deleted volume successfully. Jun 15 07:26:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6bfb94f2-d122-4bdd-8041-cb31464ce6d8 tempest-VolumeQuotasAdminTestJSON-1851190584 None] Lock "cinder-4f92f72a-e753-4f84-849a-3d0a67703854-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (baff49ae-f55e-428e-b281-9e7cada78eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b6121-8142-486b-afe2-8c4d300faeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b6121-8142-486b-afe2-8c4d300faeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-952668956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5728c6-db3c-48ff-9283-46563e1e12b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:34Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd7b83c-30d3-4dff-ac3b-ea4ecc005ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd7b83c-30d3-4dff-ac3b-ea4ecc005ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3566d6e7-f470-4d95-b80c-f434a8603e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3566d6e7-f470-4d95-b80c-f434a8603e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5728c6-db3c-48ff-9283-46563e1e12b7', 'volume_name': 'volume-1f5728c6-db3c-48ff-9283-46563e1e12b7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef819903-76e6-4f42-9736-effe18ad6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef819903-76e6-4f42-9736-effe18ad6e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3276c9fe-5b80-4587-91f2-3fb4c5a2c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Volume 1f5728c6-db3c-48ff-9283-46563e1e12b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5728c6-db3c-48ff-9283-46563e1e12b7', 'volume_size': 1} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-952668956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5728c6-db3c-48ff-9283-46563e1e12b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337c5d545e6d4cb58ba320dec306cdaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:34Z,use_quota=True,user_id='619ec81ba8d94fbba53935d9e87ddc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Creating volume 1f5728c6-db3c-48ff-9283-46563e1e12b7 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:26:34 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:26:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:34 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 1073741824 Jun 15 07:26:34 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:35 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 1073741824" returned: 0 in 1.198s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:35 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 Jun 15 07:26:35 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:36 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7" returned: 0 in 0.670s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.393s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3276c9fe-5b80-4587-91f2-3fb4c5a2c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5728c6-db3c-48ff-9283-46563e1e12b7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a977ee-ff52-4f24-90e6-bc04ff216d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc78ab-bf5e-4802-9085-aa4fd2c6280d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Volume volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 (1f5728c6-db3c-48ff-9283-46563e1e12b7): created successfully Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a977ee-ff52-4f24-90e6-bc04ff216d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Flow 'volume_create_manager' (baff49ae-f55e-428e-b281-9e7cada78eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-640d4b17-0839-4fd7-a392-8fb6e9144b19 tempest-AttachVolumeTestJSON-803141174 None] Created volume successfully. Jun 15 07:26:36 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:26:36 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:37 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.869s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:37 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d8782f-b754-4028-946e-98f571b01be0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:37 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:26:37 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:38 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.854s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.5dd19f2a-1096-4531-bc23-94fe62146c4bgl3zilm6.img {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:38 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.5dd19f2a-1096-4531-bc23-94fe62146c4bgl3zilm6.img Jun 15 07:26:38 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=60,cinder:SELECT=63,cinder:INSERT=17,cinder:DELETE=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=67,cinder:UPDATE=71,cinder:INSERT=12,cinder:DELETE=5 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Flow 'volume_create_manager' (51df38aa-de7c-4867-a371-310300149489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590c4043-10dc-4303-a192-6626d2670e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590c4043-10dc-4303-a192-6626d2670e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-66362311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fef809-3c69-4897-bbe9-20e718237a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41a71d4e5fe45cbae04e6f7010e17d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:40Z,use_quota=True,user_id='f7703a430bd645bea286e163edd9bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a94e39d-67c5-4747-844a-946120b133e8),volume_type_id=3a94e39d-67c5-4747-844a-946120b133e8)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146a131-26f6-4845-894b-566064f8cda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146a131-26f6-4845-894b-566064f8cda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766c09a9-dc24-4440-afb6-5509c2a3a253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766c09a9-dc24-4440-afb6-5509c2a3a253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fef809-3c69-4897-bbe9-20e718237a25', 'volume_name': 'volume-e8fef809-3c69-4897-bbe9-20e718237a25', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1a1be-10b0-4001-9277-98a22dee482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe1a1be-10b0-4001-9277-98a22dee482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbe13e1-a879-46c4-b305-3f9aa70cbdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:26:39 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Volume e8fef809-3c69-4897-bbe9-20e718237a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fef809-3c69-4897-bbe9-20e718237a25', 'volume_size': 1} Jun 15 07:26:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:44 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.5dd19f2a-1096-4531-bc23-94fe62146c4bgl3zilm6.img" returned: 0 in 6.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0e35c-db28-4360-b996-f33ae2cd78c2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:26:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:45 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:26:45 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:45 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 1.003s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:45 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.5dd19f2a-1096-4531-bc23-94fe62146c4bgl3zilm6.img {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:26:45 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Converted 1024.00 MB image at 153.45 MB/s Jun 15 07:26:45 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] 5dd19f2a-1096-4531-bc23-94fe62146c4b was raw, no need to convert to raw {{(pid=91865) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:26:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:26:46 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:26:46 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:26:47 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jun 15 07:26:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.663s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:26:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:26:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:26:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:26:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:26:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:26:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=3 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.833s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Uploaded volume to glance image-id: 5dd19f2a-1096-4531-bc23-94fe62146c4b. {{(pid=91865) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.491s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-66362311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fef809-3c69-4897-bbe9-20e718237a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41a71d4e5fe45cbae04e6f7010e17d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:26:40Z,use_quota=True,user_id='f7703a430bd645bea286e163edd9bb80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a94e39d-67c5-4747-844a-946120b133e8),volume_type_id=3a94e39d-67c5-4747-844a-946120b133e8)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Creating volume e8fef809-3c69-4897-bbe9-20e718237a25 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:05 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:05 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 1073741824 Jun 15 07:27:05 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:05 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4d740ce0-069f-4ba5-89ef-f1b35b70e597 tempest-VolumesActionsTest-1584130541 None] Copy volume to image completed successfully. Jun 15 07:27:06 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 1073741824" returned: 0 in 0.812s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:06 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 Jun 15 07:27:06 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:06 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25" returned: 0 in 0.630s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.193s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbe13e1-a879-46c4-b305-3f9aa70cbdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fef809-3c69-4897-bbe9-20e718237a25', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505bab0-86ca-41f5-8a88-0a6d74bcb6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a452b298-264b-47e2-a442-295bd00f18df]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Volume volume-e8fef809-3c69-4897-bbe9-20e718237a25 (e8fef809-3c69-4897-bbe9-20e718237a25): created successfully Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e505bab0-86ca-41f5-8a88-0a6d74bcb6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Flow 'volume_create_manager' (51df38aa-de7c-4867-a371-310300149489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f49e6f64-44aa-4b1b-9b52-861be1611742 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Created volume successfully. Jun 15 07:27:06 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 Jun 15 07:27:06 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:07 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7" returned: 0 in 0.733s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.097s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb2e7f-4aea-40ff-9bd1-d9f1c9419a50]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-1f5728c6-db3c-48ff-9283-46563e1e12b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7df2688c-3df6-4006-9668-0203fe9e20e8', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:27:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-f518fda1-346d-4c69-baf1-a390f155e009 req-53b87841-8fb9-4da4-a51c-6fe04c7abc43 tempest-AttachVolumeTestJSON-803141174 None] attachment_update completed successfully. Jun 15 07:27:07 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:27:07 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:08 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:08 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:08 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 1.009s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d80743-47ff-458b-a902-b825026176e8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:08 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:27:08 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:08 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.712s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:08 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1d85ad0b-5dcf-43d8-9648-0af2cc55c57d tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Retype volume completed successfully. Jun 15 07:27:09 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.834s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:09 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img Jun 15 07:27:09 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "cinder-e8fef809-3c69-4897-bbe9-20e718237a25-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "cinder-e8fef809-3c69-4897-bbe9-20e718237a25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "cinder-quobyte-e8fef809-3c69-4897-bbe9-20e718237a25" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "cinder-quobyte-e8fef809-3c69-4897-bbe9-20e718237a25" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b45dc5-7caf-4a63-b378-9a79624395fb]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:09 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 Jun 15 07:27:09 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:10 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25" returned: 0 in 1.346s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:11 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25 Jun 15 07:27:11 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:12 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8fef809-3c69-4897-bbe9-20e718237a25" returned: 0 in 1.084s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "cinder-quobyte-e8fef809-3c69-4897-bbe9-20e718237a25" released by "delete_volume" :: held 2.498s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:12 devstack cinder-volume[91865]: WARNING cinder.quota [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:27:12 devstack cinder-volume[91865]: WARNING cinder.quota [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Created reservations ['5eb60b24-a928-47ba-9382-e50bb8327e1d', '1c00f7b7-a35e-46db-8527-99b31e615332', '9bddf60d-d8ca-4a28-895c-2ef9224c9f8f', 'e59983c7-ac59-443d-935c-20c0fec0dd5e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:12 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:12 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:13 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.255s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:13 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Deleted volume successfully. Jun 15 07:27:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-315c402e-a058-4ae0-8cff-a5b0d60b0752 tempest-VolumeRetypeWithoutMigrationTest-1883740492 None] Lock "cinder-e8fef809-3c69-4897-bbe9-20e718237a25-delete_volume" released by "delete_volume" :: held 4.258s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-ee6569f8-c455-4d84-aa8b-32d2403f0682 req-280fbe09-68a4-4693-a83e-93d01bb93921 tempest-AttachVolumeTestJSON-803141174 None] Terminate volume connection completed successfully. Jun 15 07:27:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ee6569f8-c455-4d84-aa8b-32d2403f0682 req-280fbe09-68a4-4693-a83e-93d01bb93921 tempest-AttachVolumeTestJSON-803141174 None] Deleting attachment 89a01961-b4f8-44b3-b756-cbc277d51928. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:27:15 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img" returned: 0 in 6.008s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[85774c88-6be1-47a1-bedf-1a3067f80157]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:15 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:27:15 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "cinder-b5249b9f-559a-488d-b57d-431ce2d81cae-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-b5249b9f-559a-488d-b57d-431ce2d81cae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "cinder-quobyte-b5249b9f-559a-488d-b57d-431ce2d81cae" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-quobyte-b5249b9f-559a-488d-b57d-431ce2d81cae" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf59bc-04c3-4551-b4c1-5f8debe63b30]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:16 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae Jun 15 07:27:16 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:16 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 1.180s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:27:16 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Converted 1024.00 MB image at 170.40 MB/s Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] 49ee3548-5f31-4779-b1e2-c5a933550ed9 was raw, converting to qcow2 {{(pid=91865) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcbd85-addd-440e-9810-e88154052a62]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:16 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img Jun 15 07:27:16 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:17 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae" returned: 0 in 0.844s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:17 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae Jun 15 07:27:17 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:17 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img" returned: 0 in 0.747s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:17 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img Jun 15 07:27:17 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:18 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-c85f9f92-41c6-49ce-a05f-65877cfcb29c req-0d21cfd0-3f5a-435e-8df6-e22e89301f96 tempest-AttachVolumeTestJSON-803141174 None] Terminate volume connection completed successfully. Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-c85f9f92-41c6-49ce-a05f-65877cfcb29c req-0d21cfd0-3f5a-435e-8df6-e22e89301f96 tempest-AttachVolumeTestJSON-803141174 None] Deleting attachment 7df2688c-3df6-4006-9668-0203fe9e20e8. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:27:18 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b5249b9f-559a-488d-b57d-431ce2d81cae" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-quobyte-b5249b9f-559a-488d-b57d-431ce2d81cae" released by "delete_volume" :: held 1.728s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Created reservations ['d6ab329b-ac40-4198-aa87-e6a528eedd6e', '4423c51f-0c03-4e10-a106-986c99550abb', '85e14ddf-cba2-4bb8-af23-b0d375152815', '66e86f17-16b4-4e76-82cf-b51ac1540291'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:18 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img" returned: 1 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img /opt/stack/data/cinder/conversion/vol_upload__7760w4m {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:18 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img /opt/stack/data/cinder/conversion/vol_upload__7760w4m Jun 15 07:27:18 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:18 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:18 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "cinder-7efc4eb6-01ed-4240-864f-91e5550571c2-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-7efc4eb6-01ed-4240-864f-91e5550571c2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "cinder-quobyte-7efc4eb6-01ed-4240-864f-91e5550571c2" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-quobyte-7efc4eb6-01ed-4240-864f-91e5550571c2" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c37696-82d3-4a19-85c7-5c068b5b425f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:18 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 Jun 15 07:27:18 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:19 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.782s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Deleted volume successfully. Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17bc7143-554c-4990-92d1-fcac60eb206a tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-b5249b9f-559a-488d-b57d-431ce2d81cae-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:19 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img /opt/stack/data/cinder/conversion/vol_upload__7760w4m" returned: 0 in 0.914s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Image conversion details: src /opt/stack/data/cinder/conversion/cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5.temp_image.49ee3548-5f31-4779-b1e2-c5a933550ed92tq81dqi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__7760w4m {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:27:19 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9252f446-b527-4d42-9cd6-c7352d03c4e1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7760w4m {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:19 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7760w4m Jun 15 07:27:19 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:19 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2" returned: 0 in 0.803s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:19 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2 Jun 15 07:27:19 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:19 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__7760w4m" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:20 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7efc4eb6-01ed-4240-864f-91e5550571c2" returned: 0 in 0.683s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-quobyte-7efc4eb6-01ed-4240-864f-91e5550571c2" released by "delete_volume" :: held 1.545s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Created reservations ['d26d50df-e244-45e1-a6d6-2db4f900defc', '3aa35528-8de3-466c-bc2f-692d88c67b0f', '1c37abed-b0c0-4c8f-aeaf-6c05176aa888', '7ea6de79-afdd-45a6-8cb7-0c9f2ff26d3a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:20 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:20 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:21 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.765s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Deleted volume successfully. Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d53b3666-0d3d-480d-9301-1c112548a4a9 tempest-AttachVolumeShelveTestJSON-750972458 None] Lock "cinder-7efc4eb6-01ed-4240-864f-91e5550571c2-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Flow 'volume_create_manager' (b0715b0e-7014-4bd8-a0f2-4fd8380f2fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad509ab-faee-45fe-8bae-649cda7cbb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad509ab-faee-45fe-8bae-649cda7cbb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1815413581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b461951c-1ca9-4fe9-9e6e-feda404e9370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bc66f55a3b4f7c9bbab1fcc10a8c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:21Z,use_quota=True,user_id='d3c90c4055914c8bb1992a52b59269b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bafa18-4e52-40c7-9066-9d38c251412a),volume_type_id=10bafa18-4e52-40c7-9066-9d38c251412a)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136e6add-575d-47fa-9ace-e397d2f0d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136e6add-575d-47fa-9ace-e397d2f0d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e3368-2f16-4571-9107-dbc6d90206b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e3368-2f16-4571-9107-dbc6d90206b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b461951c-1ca9-4fe9-9e6e-feda404e9370', 'volume_name': 'volume-b461951c-1ca9-4fe9-9e6e-feda404e9370', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed11df97-2075-443b-b957-ed7f748b23b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed11df97-2075-443b-b957-ed7f748b23b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b5b32a-9892-4d07-8b57-9d21bbb80a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:21 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Volume b461951c-1ca9-4fe9-9e6e-feda404e9370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b461951c-1ca9-4fe9-9e6e-feda404e9370', 'volume_size': 1} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.180s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Uploaded volume to glance image-id: 49ee3548-5f31-4779-b1e2-c5a933550ed9. {{(pid=91865) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1815413581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b461951c-1ca9-4fe9-9e6e-feda404e9370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9bc66f55a3b4f7c9bbab1fcc10a8c9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:21Z,use_quota=True,user_id='d3c90c4055914c8bb1992a52b59269b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bafa18-4e52-40c7-9066-9d38c251412a),volume_type_id=10bafa18-4e52-40c7-9066-9d38c251412a)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Creating volume b461951c-1ca9-4fe9-9e6e-feda404e9370 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:21 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:21 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 1073741824 Jun 15 07:27:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8958194d-e360-41ab-b1ae-6620a93e0611 tempest-VolumesActionsTest-1584130541 None] Copy volume to image completed successfully. Jun 15 07:27:21 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:23 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 1073741824" returned: 0 in 1.346s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:23 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 Jun 15 07:27:23 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Acquiring lock "cinder-quobyte-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "cinder-quobyte-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbae5840-19b4-4895-997a-2e93117c8f91]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:23 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:27:23 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:23 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370" returned: 0 in 0.852s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] <== create_volume: return (2263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b5b32a-9892-4d07-8b57-9d21bbb80a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b461951c-1ca9-4fe9-9e6e-feda404e9370', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62c86b-8d2d-4bef-9d8f-fb6498f2ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Volume volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 (b461951c-1ca9-4fe9-9e6e-feda404e9370): created successfully Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62c86b-8d2d-4bef-9d8f-fb6498f2ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Flow 'volume_create_manager' (b0715b0e-7014-4bd8-a0f2-4fd8380f2fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-bdeb4423-936a-4d3e-87ad-33ec228b14cd tempest-VolumeTypesAccessTest-635052580 None] Created volume successfully. Jun 15 07:27:24 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.939s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:24 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5 Jun 15 07:27:24 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Acquiring lock "cinder-b461951c-1ca9-4fe9-9e6e-feda404e9370-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "cinder-b461951c-1ca9-4fe9-9e6e-feda404e9370-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Acquiring lock "cinder-quobyte-b461951c-1ca9-4fe9-9e6e-feda404e9370" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "cinder-quobyte-b461951c-1ca9-4fe9-9e6e-feda404e9370" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[040446bc-8834-483e-b605-9ecfb3662d37]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:25 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 Jun 15 07:27:25 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:25 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" returned: 0 in 0.677s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "cinder-quobyte-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5" released by "delete_volume" :: held 1.689s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Created reservations ['80736553-c9c1-4e9e-9d4d-b6942aff4925', 'e1cde927-a61b-48f6-a180-d90195ca59fd', '4f41dbd5-7969-4e47-bb31-0793f3c5a0d5', '1580675b-e09c-4164-8f32-41c801cfa835'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:25 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:25 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:26 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370" returned: 0 in 1.011s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:26 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370 Jun 15 07:27:26 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:26 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.831s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Deleted volume successfully. Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-7c83568d-43eb-4439-9a1e-47601fefab6e tempest-VolumesActionsTest-1584130541 None] Lock "cinder-cbe7129a-9cd6-42e8-95c3-d94c2e0fe4f5-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:26 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b461951c-1ca9-4fe9-9e6e-feda404e9370" returned: 0 in 0.688s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "cinder-quobyte-b461951c-1ca9-4fe9-9e6e-feda404e9370" released by "delete_volume" :: held 1.749s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:26 devstack cinder-volume[91865]: WARNING cinder.quota [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1409747334 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1409747334, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:27:26 devstack cinder-volume[91865]: WARNING cinder.quota [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1409747334 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1409747334, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Created reservations ['d8fc6ee7-fda3-44cf-ab6c-1b6c5743261a', '545ae2c9-500b-425b-a317-f428d380f513', 'bc5fca61-6e03-4d8b-a4bd-dcd3347946b1', '4db2cb4b-1f0d-4f4c-85f9-d5b5bdc4fe38'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:26 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:26 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:27 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.844s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:27 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Deleted volume successfully. Jun 15 07:27:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a73dfed2-1f91-4631-9b57-21ec520d718c tempest-VolumeTypesAccessTest-635052580 None] Lock "cinder-b461951c-1ca9-4fe9-9e6e-feda404e9370-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-1f5728c6-db3c-48ff-9283-46563e1e12b7-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-1f5728c6-db3c-48ff-9283-46563e1e12b7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-quobyte-1f5728c6-db3c-48ff-9283-46563e1e12b7" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-1f5728c6-db3c-48ff-9283-46563e1e12b7" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9ddb3c-bbc9-4fd5-849b-fcdcdbff610b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:29 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 Jun 15 07:27:29 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:30 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7" returned: 0 in 1.130s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:30 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7 Jun 15 07:27:30 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:31 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1f5728c6-db3c-48ff-9283-46563e1e12b7" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-1f5728c6-db3c-48ff-9283-46563e1e12b7" released by "delete_volume" :: held 1.960s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Created reservations ['1fc7352e-0c22-4786-921e-5115e154eeaf', '7f1a0cf4-ee9e-40cd-b4e8-722db6b06378', '6049ed33-aac3-49dc-8ef5-c6bb4ab66068', '55709593-9c0e-40e5-a126-d09a4e8f6d77'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:31 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:31 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Flow 'volume_create_manager' (e70cd833-577d-4a44-9b0e-2c34d7ea7606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b38ff9a-a689-4b3e-a62d-51ef935f81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b38ff9a-a689-4b3e-a62d-51ef935f81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1911139161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917815ed-3f0f-4d2f-88a3-9aa579a813df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5435916e01d642b3a527154c1d3ed1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:32Z,use_quota=True,user_id='79bd4cb0ad5c407c997194f34809527d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b164c7-0d6c-4717-9517-582b6b3f7c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b164c7-0d6c-4717-9517-582b6b3f7c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94137a3-fbb6-4507-a9f9-feedd2631212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94137a3-fbb6-4507-a9f9-feedd2631212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917815ed-3f0f-4d2f-88a3-9aa579a813df', 'volume_name': 'volume-917815ed-3f0f-4d2f-88a3-9aa579a813df', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baf0858-51aa-43c1-af93-da2b4bacf82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baf0858-51aa-43c1-af93-da2b4bacf82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a7341c-260a-4747-85c9-562087d5792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:31 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Volume 917815ed-3f0f-4d2f-88a3-9aa579a813df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917815ed-3f0f-4d2f-88a3-9aa579a813df', 'volume_size': 1} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1911139161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917815ed-3f0f-4d2f-88a3-9aa579a813df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5435916e01d642b3a527154c1d3ed1e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:32Z,use_quota=True,user_id='79bd4cb0ad5c407c997194f34809527d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Creating volume 917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:31 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:32 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df 1073741824 Jun 15 07:27:32 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:32 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Deleted volume successfully. Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-431f91d3-5447-4a6e-9a90-e92728f64cf7 tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-1f5728c6-db3c-48ff-9283-46563e1e12b7-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-quobyte-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[30638015-b40e-47ff-a26d-c9a9f063a9ef]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:33 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df 1073741824" returned: 0 in 1.122s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:33 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df Jun 15 07:27:33 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:33 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d Jun 15 07:27:33 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:34 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df" returned: 0 in 0.875s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a7341c-260a-4747-85c9-562087d5792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917815ed-3f0f-4d2f-88a3-9aa579a813df', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477b1ea5-c62e-45a0-8e32-512518770773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Volume volume-917815ed-3f0f-4d2f-88a3-9aa579a813df (917815ed-3f0f-4d2f-88a3-9aa579a813df): created successfully Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477b1ea5-c62e-45a0-8e32-512518770773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Flow 'volume_create_manager' (e70cd833-577d-4a44-9b0e-2c34d7ea7606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-ed035d27-d913-4136-9059-db631d97d111 req-79899e10-354f-4012-9526-b54ad49dbc51 tempest-VolumesSnapshotsTestJSON-334330529 None] Created volume successfully. Jun 15 07:27:34 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" returned: 0 in 1.082s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:34 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d Jun 15 07:27:34 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:34 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" returned: 0 in 0.695s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d" released by "delete_volume" :: held 1.850s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:34 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Created reservations ['7c1c03b0-c2f8-405e-b084-ce024ba33731', 'f8c775a5-b78b-4ba6-9a98-3fb9c26a1e90', 'aecead68-3fdd-4435-88fa-f73b7e4f422a', 'ae808f9c-5b6d-4bae-a005-a99ea018ab76'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:35 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:35 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "cinder-quobyte-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b4249c-04cd-4fc6-b562-db22c29c304a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Creating offline snapshot a690e314-bba1-488a-8caa-00612effc6e8 of volume 917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:27:35 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a Jun 15 07:27:35 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f306838b-cb2c-4549-93bd-ac17d2764f7e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:35 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.941s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:35 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Deleted volume successfully. Jun 15 07:27:36 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df Jun 15 07:27:36 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9e2528dc-9845-407e-aac6-bef265f347ac tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-6aa31a5f-7f4a-4cb2-b39f-b2e816a0e90d-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:36 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" returned: 0 in 1.072s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:36 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a Jun 15 07:27:36 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:36 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df" returned: 0 in 0.939s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:36 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 1G Jun 15 07:27:36 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:37 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" returned: 0 in 0.806s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-quobyte-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a" released by "delete_volume" :: held 1.971s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Created reservations ['894d10c4-d207-40d7-ba76-694bcd219e08', '8800eca6-103d-4797-b1ec-f54558941517', '5543ae8d-f7ca-4e4c-ac19-6422dcb0a599', '22a68283-5145-4a61-8d48-d05afa9d7a5a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:37 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:37 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:38 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 1G" returned: 0 in 1.299s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917815ed-3f0f-4d2f-88a3-9aa579a813df -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:38 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917815ed-3f0f-4d2f-88a3-9aa579a813df -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 Jun 15 07:27:38 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:38 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.742s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Deleted volume successfully. Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-966c3794-6e11-4645-96ca-41925d24f9fb tempest-AttachVolumeTestJSON-803141174 None] Lock "cinder-a1a3e2a6-a63f-4363-beff-d5a7d5f9342a-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:38 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-917815ed-3f0f-4d2f-88a3-9aa579a813df -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8" returned: 0 in 0.731s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:38 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 is being set with open permissions: ugo+rw Jun 15 07:27:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:38 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 Jun 15 07:27:38 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:39 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8" returned: 0 in 0.723s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:39 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info Jun 15 07:27:39 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:40 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info" returned: 0 in 0.698s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:40 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info is being set with open permissions: ugo+rw Jun 15 07:27:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:40 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info Jun 15 07:27:40 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:40 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.info" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.274s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-3cd8d5d4-bd65-4efe-ba26-bce1ce26cc95 req-45bfb7f8-54b1-4f96-8a1a-f841f40af120 tempest-VolumesSnapshotsTestJSON-334330529 None] Create snapshot completed successfully Jun 15 07:27:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "cinder-a690e314-bba1-488a-8caa-00612effc6e8-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-a690e314-bba1-488a-8caa-00612effc6e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "cinder-quobyte-a690e314-bba1-488a-8caa-00612effc6e8" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-a690e314-bba1-488a-8caa-00612effc6e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Deleting offline snapshot a690e314-bba1-488a-8caa-00612effc6e8 of volume 917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] snapshot_file for this snap is: volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[30409fc7-ca16-4d55-8462-7f408fdf2d25]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:42 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 Jun 15 07:27:42 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:42 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8" returned: 0 in 0.859s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-917815ed-3f0f-4d2f-88a3-9aa579a813df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:27:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95cc45-36b6-45b8-9099-e49701879741]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:43 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df Jun 15 07:27:43 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:43 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df" returned: 0 in 0.844s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:43 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 Jun 15 07:27:43 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:44 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8" returned: 0 in 0.819s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:44 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8 Jun 15 07:27:44 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:45 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df.a690e314-bba1-488a-8caa-00612effc6e8" returned: 0 in 0.851s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-a690e314-bba1-488a-8caa-00612effc6e8" released by "_delete_snapshot" :: held 3.559s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" released by "delete_snapshot" :: held 3.588s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:45 devstack cinder-volume[91865]: DEBUG cinder.quota [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Created reservations ['a040a2ee-c744-42d9-893a-ac366ab5e267', 'a1841086-fb45-459f-bae4-aa64f838d3dd', '972bcba5-c5fd-4a50-98f9-1dd21d55c621', 'afa13688-c923-4dbc-b3e9-e174dbff39fb'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Delete snapshot completed successfully. Jun 15 07:27:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-971c604c-180e-4a2f-9989-6edf88252f9a req-e861bd5e-1a5d-4260-b222-93c294b4328c tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-a690e314-bba1-488a-8caa-00612effc6e8-delete_snapshot" released by "delete_snapshot" :: held 3.796s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (d723f6fa-6285-480e-8fff-088043cff3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbcdbed-e6e4-45d8-ad25-f026290f2034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbcdbed-e6e4-45d8-ad25-f026290f2034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1046458809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525ea230-19c9-48f9-9c8b-b4b15d3d4359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:46Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd505243-4277-4ce9-88a5-eb70a488106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd505243-4277-4ce9-88a5-eb70a488106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c301dc-c245-49c0-b195-9bf2489f5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c301dc-c245-49c0-b195-9bf2489f5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '525ea230-19c9-48f9-9c8b-b4b15d3d4359', 'volume_name': 'volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6c7aaf-99ee-4d17-9a4a-8b77c5d75e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6c7aaf-99ee-4d17-9a4a-8b77c5d75e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4658f3-a806-4c2c-ba4f-bd15c7192a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Volume 525ea230-19c9-48f9-9c8b-b4b15d3d4359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359', 'volume_size': 1} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1046458809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525ea230-19c9-48f9-9c8b-b4b15d3d4359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:46Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Creating volume 525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:46 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:46 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 1073741824 Jun 15 07:27:46 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "cinder-917815ed-3f0f-4d2f-88a3-9aa579a813df-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-917815ed-3f0f-4d2f-88a3-9aa579a813df-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:46 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:46 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[728d53e1-3d05-45db-9c4e-ffe73ce38cba]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:47 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df Jun 15 07:27:47 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:47 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.881s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:27:47 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 1073741824" returned: 0 in 1.183s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:47 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 Jun 15 07:27:47 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:48 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df" returned: 0 in 1.261s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:48 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df Jun 15 07:27:48 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:48 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359" returned: 0 in 0.875s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4658f3-a806-4c2c-ba4f-bd15c7192a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd030ea3-c30c-4a91-ba49-641b15f6e186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:48 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Volume volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 (525ea230-19c9-48f9-9c8b-b4b15d3d4359): created successfully Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd030ea3-c30c-4a91-ba49-641b15f6e186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (d723f6fa-6285-480e-8fff-088043cff3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a1c976f8-b788-4c0d-92ff-6fa433afb6d4 tempest-VolumesSnapshotTestJSON-843270261 None] Created volume successfully. Jun 15 07:27:48 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-917815ed-3f0f-4d2f-88a3-9aa579a813df" returned: 0 in 0.820s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-quobyte-917815ed-3f0f-4d2f-88a3-9aa579a813df" released by "delete_volume" :: held 2.198s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.quota [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Created reservations ['435b99c3-3a2c-4dfb-9f7f-7dc1e3926931', '6e88776b-e9d1-4c6b-875b-d01241c71fde', '2f6c0310-9d31-4760-b15c-280640347a11', '30d7490e-1860-4dbf-b251-8c18d6e7e904'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:49 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:49 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Creating offline snapshot d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 of volume 525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fa2082-2a9e-4acd-92dc-5689f550e3ed]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:49 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 Jun 15 07:27:49 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:49 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.808s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.manager [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:27:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Deleted volume successfully. Jun 15 07:27:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-d8ae100d-33a7-457d-9ad9-8cb330000cfa req-45e51070-1c66-4da3-94bf-1181d8113c03 tempest-VolumesSnapshotsTestJSON-334330529 None] Lock "cinder-917815ed-3f0f-4d2f-88a3-9aa579a813df-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:50 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359" returned: 0 in 1.024s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:50 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 1G Jun 15 07:27:50 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Flow 'volume_create_manager' (d0aaba2a-d8a1-4115-a470-d1fc8f630697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f654f85e-af1d-46c7-8dac-71258a6a7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f654f85e-af1d-46c7-8dac-71258a6a7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1047333610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe723c-1f9b-40ce-9b3a-ad1f262df5f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9b319b6a65446378c916ae390ec93ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:51Z,use_quota=True,user_id='22eabc5fcfc0496995e4643e6e41bc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfb5553-ea39-4306-9c89-c1509d57c71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfb5553-ea39-4306-9c89-c1509d57c71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df022145-e551-4b41-a280-8c12486f8f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df022145-e551-4b41-a280-8c12486f8f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fe723c-1f9b-40ce-9b3a-ad1f262df5f3', 'volume_name': 'volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5c309d-3555-42b1-a8ab-33018b229fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5c309d-3555-42b1-a8ab-33018b229fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bed85a-25ec-4d5d-b9c8-5c6a872d29ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:51 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Volume 70fe723c-1f9b-40ce-9b3a-ad1f262df5f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3', 'volume_size': 1} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:51 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 1G" returned: 0 in 0.972s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:51 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 Jun 15 07:27:51 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:52 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" returned: 0 in 0.778s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:52 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 is being set with open permissions: ugo+rw Jun 15 07:27:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:52 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 Jun 15 07:27:52 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:52 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" returned: 0 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:53 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info Jun 15 07:27:53 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:53 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info" returned: 0 in 0.721s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:53 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info is being set with open permissions: ugo+rw Jun 15 07:27:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:53 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info Jun 15 07:27:53 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:54 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.info" returned: 0 in 0.799s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.184s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1047333610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fe723c-1f9b-40ce-9b3a-ad1f262df5f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9b319b6a65446378c916ae390ec93ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:51Z,use_quota=True,user_id='22eabc5fcfc0496995e4643e6e41bc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Creating volume 70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:54 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:54 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 1073741824 Jun 15 07:27:54 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:54 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ba7f84f3-efa6-4eb0-8fd3-0c1d78fd9d2d tempest-VolumesSnapshotTestJSON-843270261 None] Create snapshot completed successfully Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (be40e299-2a01-4e24-b2eb-acaad8747d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7173ccf-d2e3-4954-8c34-3a6a90afdb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7173ccf-d2e3-4954-8c34-3a6a90afdb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1779717256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b953ce0-cdbc-4d0b-91ce-a4f293e4c726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:55Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8147de57-c9f2-4f7c-bf11-4a2e74b21149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8147de57-c9f2-4f7c-bf11-4a2e74b21149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20152d-4688-4327-a4ff-24a6310f4364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b20152d-4688-4327-a4ff-24a6310f4364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b953ce0-cdbc-4d0b-91ce-a4f293e4c726', 'volume_name': 'volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd40815-e33d-41a0-aef8-0e02fe2817c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd40815-e33d-41a0-aef8-0e02fe2817c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4750a7-5a66-4b0b-9c94-fbaacc25bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Volume 4b953ce0-cdbc-4d0b-91ce-a4f293e4c726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726', 'volume_size': 1} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:55 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 1073741824" returned: 0 in 1.003s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:55 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 Jun 15 07:27:55 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=91,cinder:UPDATE=94,cinder:INSERT=27,cinder:DELETE=6 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=108,cinder:SELECT=84,cinder:DELETE=9,cinder:INSERT=20 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:27:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Deleting offline snapshot d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 of volume 525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] snapshot_file for this snap is: volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506dc64-61ba-4051-8e13-1b8354bff579]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:56 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 Jun 15 07:27:56 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:56 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" returned: 0 in 0.703s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.346s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1779717256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b953ce0-cdbc-4d0b-91ce-a4f293e4c726,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:27:55Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Creating volume 4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:27:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bed85a-25ec-4d5d-b9c8-5c6a872d29ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7ada15-9da9-4608-b274-9cacfb8ca586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:56 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 1073741824 Jun 15 07:27:56 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:56 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Volume volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 (70fe723c-1f9b-40ce-9b3a-ad1f262df5f3): created successfully Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd7ada15-9da9-4608-b274-9cacfb8ca586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Flow 'volume_create_manager' (d0aaba2a-d8a1-4115-a470-d1fc8f630697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-bd792d65-bc57-40da-9abc-c6373884f7e9 req-0c3f787c-f702-488b-b350-66735bfdb061 tempest-VolumesGetTestJSON-2075711679 None] Created volume successfully. Jun 15 07:27:56 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" returned: 0 in 0.824s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9c5ac1-5e63-426b-951c-9315b1474a20]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:57 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 Jun 15 07:27:57 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Acquiring lock "cinder-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "cinder-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Acquiring lock "cinder-quobyte-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "cinder-quobyte-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde39ee-269e-4c51-83f6-06452d547e69]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:57 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 1073741824" returned: 0 in 1.289s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:57 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 Jun 15 07:27:57 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:57 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 Jun 15 07:27:57 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:57 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359" returned: 0 in 1.004s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:58 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 Jun 15 07:27:58 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:58 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" returned: 0 in 0.912s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:58 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3 Jun 15 07:27:58 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:58 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" returned: 0 in 0.991s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] <== create_volume: return (2349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.353s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4750a7-5a66-4b0b-9c94-fbaacc25bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65255701-cc1e-4669-8ec6-ee7f11265516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:27:58 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Volume volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 (4b953ce0-cdbc-4d0b-91ce-a4f293e4c726): created successfully Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65255701-cc1e-4669-8ec6-ee7f11265516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (be40e299-2a01-4e24-b2eb-acaad8747d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:27:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c897ba56-7bff-4139-9120-f7d02790ab86 tempest-VolumesTestJSON-699104305 None] Created volume successfully. Jun 15 07:27:58 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" returned: 0 in 0.919s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:58 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748 Jun 15 07:27:58 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:59 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" returned: 0 in 0.817s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "cinder-quobyte-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3" released by "delete_volume" :: held 1.799s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.quota [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Created reservations ['0026e716-6bf2-4455-8a27-709557581caa', 'a28260e5-4284-4a3f-b38a-c84de6f4b996', 'd95d9538-a40a-4ae7-97b6-79db55e070cb', '8ee8ca9e-fc26-4083-bbd0-66d0043655f0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:27:59 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:27:59 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:27:59 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359.d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" returned: 0 in 0.709s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748" released by "_delete_snapshot" :: held 3.680s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" released by "delete_snapshot" :: held 3.720s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:27:59 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['4b27e39b-bbf7-49fd-bc7f-c822cb5c3d6b', '251aa2ed-a8dd-4560-8982-9db3b6e2617c', 'd0569615-3c89-4430-a2a9-dc3ccee46e4f', '9b29dd07-d7e4-4b7e-aa86-936cad3c8bd4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:27:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Delete snapshot completed successfully. Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-006dd74f-f9d0-4222-baaf-7b3f96f8c412 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-d6c4d1b9-80a3-4ba7-9ac8-6a4d3537d748-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (91ddcd44-75dd-455b-a774-d96a3702a7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c78d6c-4ecf-4cc4-9599-17b2b5f9c747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c78d6c-4ecf-4cc4-9599-17b2b5f9c747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-295666989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7f309f-d13f-483d-8d6c-1b31782e9d10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:00Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df581ff9-4ac8-48b3-bde8-90a738f988a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df581ff9-4ac8-48b3-bde8-90a738f988a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65095f8a-a737-4c10-9ba8-6e70e63df0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65095f8a-a737-4c10-9ba8-6e70e63df0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7f309f-d13f-483d-8d6c-1b31782e9d10', 'volume_name': 'volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4389349-5f2d-4f38-bbdc-ce125dbc8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4389349-5f2d-4f38-bbdc-ce125dbc8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a83ef4-d934-4c25-9adf-0bc380bf31b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:00 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Volume cb7f309f-d13f-483d-8d6c-1b31782e9d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10', 'volume_size': 1} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-295666989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7f309f-d13f-483d-8d6c-1b31782e9d10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:00Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Creating volume cb7f309f-d13f-483d-8d6c-1b31782e9d10 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:00 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:00 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 1073741824 Jun 15 07:28:00 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:00 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.046s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.manager [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:00 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Deleted volume successfully. Jun 15 07:28:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-bf074eb7-dd24-44e4-b425-ddd9d51a4acd req-55e6cd16-b802-4466-8978-d96b003323a6 tempest-VolumesGetTestJSON-2075711679 None] Lock "cinder-70fe723c-1f9b-40ce-9b3a-ad1f262df5f3-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (a7ef4055-e68d-4630-9f6e-38e4ee9d4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644138c5-1e15-49ed-99ad-155d70bac9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (644138c5-1e15-49ed-99ad-155d70bac9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226723304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45004aa2-ab1f-4d28-b367-f80f66ce7c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:01Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e117a7-50ef-4d18-98ac-8351c7a96ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e117a7-50ef-4d18-98ac-8351c7a96ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b6c14f-33fc-4c96-876f-28046943419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b6c14f-33fc-4c96-876f-28046943419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45004aa2-ab1f-4d28-b367-f80f66ce7c2c', 'volume_name': 'volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30e831a-0391-4062-bd81-ba59e6931a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30e831a-0391-4062-bd81-ba59e6931a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf68a4c-afc4-4ae7-ae31-4f40f25914fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:01 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Volume 45004aa2-ab1f-4d28-b367-f80f66ce7c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c', 'volume_size': 1} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:01 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 1073741824" returned: 0 in 1.571s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:01 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 Jun 15 07:28:01 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:02 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10" returned: 0 in 0.758s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1226723304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45004aa2-ab1f-4d28-b367-f80f66ce7c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:01Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Creating volume 45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:02 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:02 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c 1073741824 Jun 15 07:28:02 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65a83ef4-d934-4c25-9adf-0bc380bf31b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b688c026-62d6-42af-992b-36138d92a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Volume volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 (cb7f309f-d13f-483d-8d6c-1b31782e9d10): created successfully Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b688c026-62d6-42af-992b-36138d92a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (91ddcd44-75dd-455b-a774-d96a3702a7b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-43aa1746-1493-40c5-bfd6-3adc3af00934 tempest-VolumesTestJSON-699104305 None] Created volume successfully. Jun 15 07:28:03 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c 1073741824" returned: 0 in 1.159s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:03 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:03 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (9172b2e7-10f0-4947-be5e-123b8b9ce075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1696bb52-6515-4179-9038-c783050f65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1696bb52-6515-4179-9038-c783050f65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-579554700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2027c0-a106-46e9-b083-60e4f81bf261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:04Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d1f516-7d0e-4f6d-bbf1-d4e40fe886b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d1f516-7d0e-4f6d-bbf1-d4e40fe886b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa915b-b80f-46a0-9837-6c4d84224c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa915b-b80f-46a0-9837-6c4d84224c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2027c0-a106-46e9-b083-60e4f81bf261', 'volume_name': 'volume-cc2027c0-a106-46e9-b083-60e4f81bf261', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dd011e-5f31-4338-ad8e-b026e72ef368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4dd011e-5f31-4338-ad8e-b026e72ef368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4f6d4b-e997-4403-9a9f-b52f07c0e898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Volume cc2027c0-a106-46e9-b083-60e4f81bf261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2027c0-a106-46e9-b083-60e4f81bf261', 'volume_size': 1} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:04 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 0.755s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-579554700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2027c0-a106-46e9-b083-60e4f81bf261,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7303df8037b34c03be65e1f9682fbe0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:04Z,use_quota=True,user_id='d2bac2b9d4cc4d5c809ad7324321d9cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Creating volume cc2027c0-a106-46e9-b083-60e4f81bf261 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:04 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:04 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 1073741824 Jun 15 07:28:04 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf68a4c-afc4-4ae7-ae31-4f40f25914fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068ddcca-d87b-4419-866b-ee1efff4607b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Volume volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c (45004aa2-ab1f-4d28-b367-f80f66ce7c2c): created successfully Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068ddcca-d87b-4419-866b-ee1efff4607b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (a7ef4055-e68d-4630-9f6e-38e4ee9d4811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:04 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-81af14be-691b-4a3c-a9b9-a689e94e69d0 tempest-VolumesSnapshotTestJSON-843270261 None] Created volume successfully. Jun 15 07:28:05 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 1073741824" returned: 0 in 1.011s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:05 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 Jun 15 07:28:05 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:06 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261" returned: 0 in 0.773s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.551s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Creating offline snapshot d80f41f6-498a-4d68-9e38-88e3a7031508 of volume 45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4f6d4b-e997-4403-9a9f-b52f07c0e898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2027c0-a106-46e9-b083-60e4f81bf261', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be3cfb-a2dc-4c47-a3bc-b67bf6737331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[10541ab0-d9c0-441e-a6a3-ecf27dfdd273]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Volume volume-cc2027c0-a106-46e9-b083-60e4f81bf261 (cc2027c0-a106-46e9-b083-60e4f81bf261): created successfully Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be3cfb-a2dc-4c47-a3bc-b67bf6737331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Flow 'volume_create_manager' (9172b2e7-10f0-4947-be5e-123b8b9ce075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-feb0894d-719a-4c30-9145-ecdf56cfb0fa tempest-VolumesTestJSON-699104305 None] Created volume successfully. Jun 15 07:28:06 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:06 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:07 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 0.945s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:07 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 1G Jun 15 07:28:07 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:08 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 1G" returned: 0 in 1.088s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-cc2027c0-a106-46e9-b083-60e4f81bf261-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:08 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:08 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "cinder-cc2027c0-a106-46e9-b083-60e4f81bf261-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-quobyte-cc2027c0-a106-46e9-b083-60e4f81bf261" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-cc2027c0-a106-46e9-b083-60e4f81bf261" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5515902f-5fd8-47a5-b40b-4b8ac592246a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:08 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 Jun 15 07:28:08 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:09 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 0.906s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:09 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 is being set with open permissions: ugo+rw Jun 15 07:28:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:09 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:09 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:09 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261" returned: 0 in 1.217s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:09 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261 Jun 15 07:28:09 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-247b8651-29ea-49fa-b5bf-5043c598b34b tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-362950324: creating Jun 15 07:28:10 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 0.924s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-247b8651-29ea-49fa-b5bf-5043c598b34b tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-362950324: created successfully Jun 15 07:28:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-247b8651-29ea-49fa-b5bf-5043c598b34b tempest-GroupSnapshotsTest-602728984 None] Create group completed successfully. Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:10 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info Jun 15 07:28:10 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:10 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cc2027c0-a106-46e9-b083-60e4f81bf261" returned: 0 in 0.923s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-cc2027c0-a106-46e9-b083-60e4f81bf261" released by "delete_volume" :: held 2.210s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Created reservations ['d68b64a3-acfd-4ff3-bb41-bcd409afbe2a', '351aacf2-dc7f-42fd-bf72-f119e32ffcdb', '2d7ff38c-b748-4acc-80d7-9ed4755f7f10', 'c9aa3ce8-49ad-4187-bfdd-b8bc16734aa1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:11 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:11 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:11 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info" returned: 0 in 0.802s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:11 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info is being set with open permissions: ugo+rw Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:11 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info Jun 15 07:28:11 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:11 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.723s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Deleted volume successfully. Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4e50ee2e-b861-4e08-a7a2-3b2929511fd6 tempest-VolumesTestJSON-699104305 None] Lock "cinder-cc2027c0-a106-46e9-b083-60e4f81bf261-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:11 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.info" returned: 0 in 0.776s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.585s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-cb7f309f-d13f-483d-8d6c-1b31782e9d10-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "cinder-cb7f309f-d13f-483d-8d6c-1b31782e9d10-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-dee01d4d-64bf-4e73-aef2-fe541272f27e tempest-VolumesSnapshotTestJSON-843270261 None] Create snapshot completed successfully Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-quobyte-cb7f309f-d13f-483d-8d6c-1b31782e9d10" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-cb7f309f-d13f-483d-8d6c-1b31782e9d10" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8a6eac-83c2-4bc7-9802-b48126579cb5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (52635bc3-6aaa-4ec1-ac81-52011c9ed712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ee36d-9b2c-4f4a-9829-ee335c378dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008ee36d-9b2c-4f4a-9829-ee335c378dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200975382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=991c0593-7ab9-4904-b386-84d52bc93f26,host='devstack@QuobyteHD#QuobyteHD',id=d3f16812-aa4a-43b1-a9ee-3faceff31db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:12Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293f5d8b-c2b5-4f72-b723-7583f6185ec7),volume_type_id=293f5d8b-c2b5-4f72-b723-7583f6185ec7)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf55c07-c9b1-4253-8c5f-35704cc492bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf55c07-c9b1-4253-8c5f-35704cc492bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927c571f-4916-474c-9745-5f0aba9ba55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927c571f-4916-474c-9745-5f0aba9ba55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f16812-aa4a-43b1-a9ee-3faceff31db3', 'volume_name': 'volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c2451-7d95-4aaa-868f-6091b4a37d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 Jun 15 07:28:12 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6c2451-7d95-4aaa-868f-6091b4a37d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4220f-1618-4e3e-9947-2b8cc8f8f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Volume d3f16812-aa4a-43b1-a9ee-3faceff31db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3', 'volume_size': 1} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=991c0593-7ab9-4904-b386-84d52bc93f26,created_at=2026-06-15T05:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200975382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=991c0593-7ab9-4904-b386-84d52bc93f26,host='devstack@QuobyteHD#QuobyteHD',id=d3f16812-aa4a-43b1-a9ee-3faceff31db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:12Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(293f5d8b-c2b5-4f72-b723-7583f6185ec7),volume_type_id=293f5d8b-c2b5-4f72-b723-7583f6185ec7)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Creating volume d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:12 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 1073741824 Jun 15 07:28:12 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (1e0d5445-8f3d-42d7-932e-4985b09973e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09103ac-43f8-4e86-b618-a4fd2d960fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c09103ac-43f8-4e86-b618-a4fd2d960fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1764488467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf13b9e-6110-4ff9-ad61-2d66359e76f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d80f41f6-498a-4d68-9e38-88e3a7031508,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:13Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f9e057-0356-4aff-a906-9aa5895be2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f9e057-0356-4aff-a906-9aa5895be2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0de8a0b-2d28-47ed-a5eb-4230f6418856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0de8a0b-2d28-47ed-a5eb-4230f6418856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dcf13b9e-6110-4ff9-ad61-2d66359e76f0', 'volume_name': 'volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0', 'volume_size': 2, 'snapshot_id': 'd80f41f6-498a-4d68-9e38-88e3a7031508'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b40bd5-fa90-43b2-b3c2-61d30bdfd9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b40bd5-fa90-43b2-b3c2-61d30bdfd9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4045891-7e06-4338-b015-f3a30e047c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Volume dcf13b9e-6110-4ff9-ad61-2d66359e76f0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0', 'volume_size': 2, 'snapshot_id': 'd80f41f6-498a-4d68-9e38-88e3a7031508'} Jun 15 07:28:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:13 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10" returned: 0 in 0.873s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:13 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10 Jun 15 07:28:13 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:13 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 1073741824" returned: 0 in 1.122s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:13 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:13 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:13 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-cb7f309f-d13f-483d-8d6c-1b31782e9d10" returned: 0 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-cb7f309f-d13f-483d-8d6c-1b31782e9d10" released by "delete_volume" :: held 1.715s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:13 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Created reservations ['c1cb3cc0-fd19-4ae7-b748-0063e82924f5', 'ea663c60-4350-440e-9e0e-33e7d02a2061', '4d38110f-2049-4f4d-9205-52665282dd96', '54118189-412a-44ad-bf23-48cbf1aab038'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:14 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:14 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "cinder-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Acquiring lock "cinder-quobyte-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:14 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 0.832s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edea241-cb5d-4e9f-bb58-c45af442cb45]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.406s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4220f-1618-4e3e-9947-2b8cc8f8f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ca2825-8e73-4cd9-a7f3-5116565131f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Creating volume dcf13b9e-6110-4ff9-ad61-2d66359e76f0 from snapshot d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:14 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Volume volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 (d3f16812-aa4a-43b1-a9ee-3faceff31db3): created successfully Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ca2825-8e73-4cd9-a7f3-5116565131f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (52635bc3-6aaa-4ec1-ac81-52011c9ed712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e578f62c-fd41-4d88-89d7-4033f1265f87 tempest-GroupSnapshotsTest-602728984 None] Created volume successfully. Jun 15 07:28:14 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 Jun 15 07:28:14 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] snapshot: d80f41f6-498a-4d68-9e38-88e3a7031508, volume: dcf13b9e-6110-4ff9-ad61-2d66359e76f0, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7282134-557b-4937-8148-0f0673c26a62]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:14 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:14 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] GroupSnapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: creating. Jun 15 07:28:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Group snapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: creating. {{(pid=91865) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:15 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.968s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Deleted volume successfully. Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4cfb9e00-82d0-47f7-86e4-69b1d41beb89 tempest-VolumesTestJSON-699104305 None] Lock "cinder-cb7f309f-d13f-483d-8d6c-1b31782e9d10-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:15 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" returned: 0 in 0.922s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:15 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726 Jun 15 07:28:15 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:15 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 0.960s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8152e3-d6e4-45b5-a74c-fa1fce2eb71e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:15 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:15 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:15 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "cinder-quobyte-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726" released by "delete_volume" :: held 1.665s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Created reservations ['4baaf1e7-82dd-4809-89af-0463dc36ef01', 'd9689d70-de44-4556-83e3-3aaf489007a3', 'e770f64c-130e-4beb-af6a-d7425dcd4505', '72284bf0-5c85-4edc-b00c-31f09c51fd18'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:16 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:16 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:16 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 0.763s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:16 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 Jun 15 07:28:16 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:16 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.637s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Deleted volume successfully. Jun 15 07:28:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d6dc4498-823c-4f86-b034-a912cf942289 tempest-VolumesTestJSON-699104305 None] Lock "cinder-4b953ce0-cdbc-4d0b-91ce-a4f293e4c726-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:22 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" returned: 0 in 6.028s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e2eb7-3ec7-43b1-b425-6025163b8d59]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:22 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:22 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:23 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 1.066s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:23 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:28:23 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Converted 1024.00 MB image at 169.84 MB/s Jun 15 07:28:23 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 is being set with open permissions: ugo+rw Jun 15 07:28:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:23 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 Jun 15 07:28:23 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-be7be258-aff8-4861-9cea-d6eeab3851b0 tempest-GroupsTest-1850557751 None] Group tempest-Group1-1635185756: creating Jun 15 07:28:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-be7be258-aff8-4861-9cea-d6eeab3851b0 tempest-GroupsTest-1850557751 None] Group tempest-Group1-1635185756: created successfully Jun 15 07:28:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-be7be258-aff8-4861-9cea-d6eeab3851b0 tempest-GroupsTest-1850557751 None] Create group completed successfully. Jun 15 07:28:24 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" returned: 0 in 0.656s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" released by "_copy_volume_from_snapshot" :: held 9.617s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" released by "_create_volume_from_snapshot" :: held 9.693s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.761s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.142s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Creating offline snapshot 7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 of volume d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3a54b-b990-49a0-ae93-71a823ce7dbc]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4045891-7e06-4338-b015-f3a30e047c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0', 'volume_size': 2, 'snapshot_id': 'd80f41f6-498a-4d68-9e38-88e3a7031508'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7081fa-472c-4013-bb9f-39d03a4137b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Volume volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 (dcf13b9e-6110-4ff9-ad61-2d66359e76f0): created successfully Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7081fa-472c-4013-bb9f-39d03a4137b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (1e0d5445-8f3d-42d7-932e-4985b09973e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-353a0221-25d8-4ff3-ae02-2e5f0cdc0366 tempest-VolumesSnapshotTestJSON-843270261 None] Created volume successfully. Jun 15 07:28:24 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:24 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:24 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 0.773s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-39788294-f957-42a1-84f1-a9d6f0ff812f tempest-GroupsTest-1850557751 None] Group tempest-Group2-1962927595: creating Jun 15 07:28:24 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 1G Jun 15 07:28:24 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-39788294-f957-42a1-84f1-a9d6f0ff812f tempest-GroupsTest-1850557751 None] Group tempest-Group2-1962927595: created successfully Jun 15 07:28:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-39788294-f957-42a1-84f1-a9d6f0ff812f tempest-GroupsTest-1850557751 None] Create group completed successfully. Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-dcf13b9e-6110-4ff9-ad61-2d66359e76f0-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-dcf13b9e-6110-4ff9-ad61-2d66359e76f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[44692e2a-6ab6-45db-8ea2-4fe4e5fd5218]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:25 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 Jun 15 07:28:25 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:25 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 1G" returned: 0 in 0.819s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:25 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:25 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:25 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" returned: 0 in 0.767s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:25 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0 Jun 15 07:28:25 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:26 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 0.737s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:26 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:26 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:26 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (a3e37369-dabe-46e0-b4fc-3683f25de064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40841a1e-3ba2-472d-b4d1-2f3c8ae9ae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40841a1e-3ba2-472d-b4d1-2f3c8ae9ae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397548917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74eb43e7-a252-425f-bfbb-987f958b5436,host='devstack@QuobyteHD#QuobyteHD',id=bd9be761-4400-4736-9991-37103b422b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:27Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b419ae7-6b36-467e-9e1a-82624700154e),volume_type_id=1b419ae7-6b36-467e-9e1a-82624700154e)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6789d2-141f-4cf3-a90c-45491e0ba215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6789d2-141f-4cf3-a90c-45491e0ba215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca54bc-c670-45ba-ad5a-67262965b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca54bc-c670-45ba-ad5a-67262965b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9be761-4400-4736-9991-37103b422b6b', 'volume_name': 'volume-bd9be761-4400-4736-9991-37103b422b6b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eceee7-9cdc-42cc-b618-6fbfa760c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69eceee7-9cdc-42cc-b618-6fbfa760c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae37ec5-98d0-4f70-94c9-cd2ca1be565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:26 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Volume bd9be761-4400-4736-9991-37103b422b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9be761-4400-4736-9991-37103b422b6b', 'volume_size': 1} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:26 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" returned: 0 in 0.763s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-dcf13b9e-6110-4ff9-ad61-2d66359e76f0" released by "delete_volume" :: held 1.573s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['8c27c0c7-ab44-4ded-a793-c82ed41d7a6e', '78fab3b2-a024-4928-8af7-35e410a0dcd6', '2e1fa616-26fd-448b-b843-58da985829f8', 'de49d13f-055c-4b7b-9895-41b5a12978e9'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:26 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:26 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:27 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 0.629s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:27 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info Jun 15 07:28:27 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-d80f41f6-498a-4d68-9e38-88e3a7031508-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-d80f41f6-498a-4d68-9e38-88e3a7031508-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:27 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.614s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Deleted volume successfully. Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Deleting offline snapshot d80f41f6-498a-4d68-9e38-88e3a7031508 of volume 45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] snapshot_file for this snap is: volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e224741-a350-4627-b784-7eb9a84ff9cf tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-dcf13b9e-6110-4ff9-ad61-2d66359e76f0-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3f69f-f768-4d5f-8909-d1a3bfcc5955]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:27 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:27 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:27 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info" returned: 0 in 0.646s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:27 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:28:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:27 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info Jun 15 07:28:27 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:28 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 0.720s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41cfa2-0638-46eb-ab18-e230766654dc]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:28 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:28 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:28 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.info" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.271s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74eb43e7-a252-425f-bfbb-987f958b5436,created_at=2026-06-15T05:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397548917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74eb43e7-a252-425f-bfbb-987f958b5436,host='devstack@QuobyteHD#QuobyteHD',id=bd9be761-4400-4736-9991-37103b422b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:27Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b419ae7-6b36-467e-9e1a-82624700154e),volume_type_id=1b419ae7-6b36-467e-9e1a-82624700154e)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Creating volume bd9be761-4400-4736-9991-37103b422b6b {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:28 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:28 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b 1073741824 Jun 15 07:28:28 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e1a28a4-5717-480f-910a-db3e6387bf3e tempest-GroupSnapshotsTest-602728984 None] group_snapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: created successfully Jun 15 07:28:29 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 1.227s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:29 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:29 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:29 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b 1073741824" returned: 0 in 1.413s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:29 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b Jun 15 07:28:29 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:30 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 1.243s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:30 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:30 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508 Jun 15 07:28:30 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b" returned: 0 in 0.863s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.348s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179-e8a77b32-1275-4eb7-bcce-3522e0428dc0" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae37ec5-98d0-4f70-94c9-cd2ca1be565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9be761-4400-4736-9991-37103b422b6b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b57b51-814a-49bc-b9cd-be697a80e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179-e8a77b32-1275-4eb7-bcce-3522e0428dc0" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Creating volume e8a77b32-1275-4eb7-bcce-3522e0428dc0 from snapshot 7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Volume volume-bd9be761-4400-4736-9991-37103b422b6b (bd9be761-4400-4736-9991-37103b422b6b): created successfully Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44b57b51-814a-49bc-b9cd-be697a80e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (a3e37369-dabe-46e0-b4fc-3683f25de064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] snapshot: 7c18b52d-39ba-46bc-8cbd-f44b2a8a8179, volume: e8a77b32-1275-4eb7-bcce-3522e0428dc0, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:28:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0ee9164f-5794-40bf-956a-3ac2dbecb271 tempest-GroupsTest-1850557751 None] Created volume successfully. Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8d51c-83ce-4dc4-ab8a-b4bb4f7e8bf5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:31 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:31 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:31 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c.d80f41f6-498a-4d68-9e38-88e3a7031508" returned: 0 in 0.938s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Acquiring lock "cinder-quobyte-bd9be761-4400-4736-9991-37103b422b6b" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-bd9be761-4400-4736-9991-37103b422b6b" acquired by "delete_volume" :: waited 0.083s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-d80f41f6-498a-4d68-9e38-88e3a7031508" released by "_delete_snapshot" :: held 4.328s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" released by "delete_snapshot" :: held 4.369s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8d698-36c7-4deb-bef8-0d47f3e584ed]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:31 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['e2bca1eb-0211-4fbe-9c9f-750a33fb93db', '2f9fc3e8-91bb-4092-ab72-6d4933665ef5', '651852ce-cc78-4ee1-b475-9df7ad1437c1', '67eac0e0-3a14-4e3c-99f5-8a138a6eec83'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:31 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b Jun 15 07:28:31 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:32 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 1.130s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:28:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Delete snapshot completed successfully. Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a9e98c7b-6a6e-48cc-b14d-7b4c218817ea tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-d80f41f6-498a-4d68-9e38-88e3a7031508-delete_snapshot" released by "delete_snapshot" :: held 4.680s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3580ff8-eb7e-49c0-9c6c-0a2c4000c727]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:32 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:32 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (6b06f52b-9c58-4fc1-9e85-2afbabc80c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c845a3-2cbb-4619-ba16-ed1bb78a8102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:32 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b" returned: 0 in 1.030s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c845a3-2cbb-4619-ba16-ed1bb78a8102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391884954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:33Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:32 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b Jun 15 07:28:32 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bcd2ad-874b-41e3-ad72-320fb021c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25bcd2ad-874b-41e3-ad72-320fb021c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a7219-f97f-433c-86eb-9318c21892dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5a7219-f97f-433c-86eb-9318c21892dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17', 'volume_name': 'volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba42f028-d482-4285-bc92-92cb3a0d97e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba42f028-d482-4285-bc92-92cb3a0d97e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa7f2d-3076-48d6-bd4a-a77e77550bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Volume 96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17', 'volume_size': 1} Jun 15 07:28:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-45004aa2-ab1f-4d28-b367-f80f66ce7c2c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-45004aa2-ab1f-4d28-b367-f80f66ce7c2c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:33 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 1.034s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:33 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 Jun 15 07:28:33 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[851429b7-2642-409c-9983-f94b9047c489]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:33 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:33 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:33 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bd9be761-4400-4736-9991-37103b422b6b" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-bd9be761-4400-4736-9991-37103b422b6b" released by "delete_volume" :: held 1.804s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Created reservations ['daaa89ed-3f20-491e-9a11-4da722be06f6'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:33 devstack cinder-volume[91865]: WARNING cinder.quota [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1584725761 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1584725761, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:28:33 devstack cinder-volume[91865]: WARNING cinder.quota [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1584725761 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1584725761, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Created reservations ['5ece9a85-395f-4e41-9d01-6525ce64a60a', '6f3ff14a-dc84-4c68-a303-42409deb23a8', '92786c21-a76c-459c-b9f8-9ab7b80f51a9', '8167ab38-e37a-4433-bf74-9602db142b9e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:33 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:33 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:34 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 1.213s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:34 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c Jun 15 07:28:34 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Created reservations ['2c4c0128-016a-41a7-b84b-a0d169d9b74c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:35 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:35 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:35 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.486s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:35 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e12a7da0-4424-4cab-8b52-c930a1241910 tempest-GroupsTest-1850557751 None] Delete group completed successfully. Jun 15 07:28:36 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" returned: 0 in 2.388s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-45004aa2-ab1f-4d28-b367-f80f66ce7c2c" released by "delete_volume" :: held 3.735s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['f673d067-cc4c-4a09-b463-84461d30c282', 'b6b157ab-4edb-490c-b989-ee1782e442c8', 'e498f95b-eaad-4b8c-994f-ea93d21473d4', '51eadbb8-2ba2-4627-8fea-6bc3e861c0d1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:37 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 2.315s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2bcd508e-d997-4847-af99-a7af3c1f90cf tempest-GroupsTest-1850557751 None] Delete group completed successfully. Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:37 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:37 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4768bc71-e497-405e-b924-cc7c6a38fbc8 tempest-GroupsTest-1850557751 None] Group tempest-GroupsTest-Group-643021306: creating Jun 15 07:28:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4768bc71-e497-405e-b924-cc7c6a38fbc8 tempest-GroupsTest-1850557751 None] Group tempest-GroupsTest-Group-643021306: created successfully Jun 15 07:28:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4768bc71-e497-405e-b924-cc7c6a38fbc8 tempest-GroupsTest-1850557751 None] Create group completed successfully. Jun 15 07:28:39 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 2.212s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:39 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Deleted volume successfully. Jun 15 07:28:39 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5a5c8063-aa4e-40ae-b92b-053cd1b3254f tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-45004aa2-ab1f-4d28-b367-f80f66ce7c2c-delete_volume" released by "delete_volume" :: held 6.605s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:39 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (52e0b7fa-5609-4372-b72f-5ebd4c08c23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99390609-2468-4273-a598-17691eadd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99390609-2468-4273-a598-17691eadd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573605650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a2b70a-713f-4d77-8a8d-3b8c33924a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:40Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d708a4d-6808-415c-bcb8-d54908573255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d708a4d-6808-415c-bcb8-d54908573255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eafdc90-efe8-4bdf-b97e-2d8e4f9789aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eafdc90-efe8-4bdf-b97e-2d8e4f9789aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a2b70a-713f-4d77-8a8d-3b8c33924a22', 'volume_name': 'volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def4a9dc-e29f-428a-b3f5-0db0b365f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def4a9dc-e29f-428a-b3f5-0db0b365f41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673aa85-3954-4795-a84d-4167596e7fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:40 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Volume f2a2b70a-713f-4d77-8a8d-3b8c33924a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22', 'volume_size': 1} Jun 15 07:28:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (18bd4f1b-7c73-41d1-8a64-38265b575dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b77b467-e03e-49ff-9c64-896049de8c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b77b467-e03e-49ff-9c64-896049de8c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223104504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,host='devstack@QuobyteHD#QuobyteHD',id=c828ddf4-f740-458d-bf4c-63261645002f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:41Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d178a6-0cdd-4a36-8ff2-655a0341a90e),volume_type_id=17d178a6-0cdd-4a36-8ff2-655a0341a90e)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a805ff-a6e3-4a76-a5ca-85e630d280d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a805ff-a6e3-4a76-a5ca-85e630d280d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e1984-fc26-434b-b059-b5807b8ad179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82e1984-fc26-434b-b059-b5807b8ad179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c828ddf4-f740-458d-bf4c-63261645002f', 'volume_name': 'volume-c828ddf4-f740-458d-bf4c-63261645002f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3999a486-2b9a-41c7-92ab-1f7da92604c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3999a486-2b9a-41c7-92ab-1f7da92604c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4194bfcc-a709-4626-b43b-3d810a4d1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:41 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Volume c828ddf4-f740-458d-bf4c-63261645002f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c828ddf4-f740-458d-bf4c-63261645002f', 'volume_size': 1} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:41 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0" returned: 0 in 8.483s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8cb57-6288-469a-9102-a75daac73052]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:41 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:41 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:42 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 1.006s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:42 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3, size 1024.00 MB, duration 8.48 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:28:42 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Converted 1024.00 MB image at 120.70 MB/s Jun 15 07:28:42 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:28:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:42 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 Jun 15 07:28:42 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:43 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" released by "_copy_volume_from_snapshot" :: held 12.391s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179-e8a77b32-1275-4eb7-bcce-3522e0428dc0" released by "_create_volume_from_snapshot" :: held 12.449s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.492s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.312s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391884954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:33Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Creating volume 96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:43 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:43 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 1073741824 Jun 15 07:28:43 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8165b92c-89a4-4b1f-af7f-66b41974f6bb tempest-GroupSnapshotsTest-602728984 None] Create group from source-snapshot-5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc completed successfully. Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8a479-dcab-4e21-b69d-add7a46e360c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:43 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 Jun 15 07:28:43 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:44 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 1073741824" returned: 0 in 0.825s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:44 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 Jun 15 07:28:44 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:44 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0" returned: 0 in 0.765s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:44 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0 Jun 15 07:28:44 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:44 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" returned: 0 in 0.615s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573605650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a2b70a-713f-4d77-8a8d-3b8c33924a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:40Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Creating volume f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:44 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:44 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 1073741824 Jun 15 07:28:44 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4aa7f2d-3076-48d6-bd4a-a77e77550bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93078189-90e3-41de-8cdb-ce0f5926c52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Volume volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 (96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17): created successfully Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93078189-90e3-41de-8cdb-ce0f5926c52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (6b06f52b-9c58-4fc1-9e85-2afbabc80c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e99ecccf-a93e-410a-a013-2e9fcff05fe4 tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:28:45 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e8a77b32-1275-4eb7-bcce-3522e0428dc0" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-e8a77b32-1275-4eb7-bcce-3522e0428dc0" released by "delete_volume" :: held 1.388s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Created reservations ['9182dee7-51cb-4289-b1db-e6e0a7a76521'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:45 devstack cinder-volume[91865]: WARNING cinder.quota [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-301197317 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-301197317, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:28:45 devstack cinder-volume[91865]: WARNING cinder.quota [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-301197317 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-301197317, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Created reservations ['61ad67a2-36c2-40a6-af3d-9fea3f231d39', '8b0f6ab1-462b-4560-9be3-e66e7857fafc', '2e07040e-ada4-481f-81c6-9380ee77d72d', 'e540a512-582a-4037-a34d-b594cd222e5f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:45 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:45 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:45 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 1073741824" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2562ba97-7c13-4628-8aed-853491113bc1 tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" by "attach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:45 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:28:45 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2562ba97-7c13-4628-8aed-853491113bc1 tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" acquired by "attach_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2562ba97-7c13-4628-8aed-853491113bc1 tempest-VolumesActionsTest-155708643 None] Attaching volume 96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 to instance 684c518d-eb3d-4ae6-a08d-f4b642028573 at mountpoint /dev/vdb on host None. Jun 15 07:28:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2562ba97-7c13-4628-8aed-853491113bc1 tempest-VolumesActionsTest-155708643 None] Attach volume completed successfully. Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2562ba97-7c13-4628-8aed-853491113bc1 tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" released by "attach_volume" :: held 0.092s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:45 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.614s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:45 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f84b473d-6f44-40ac-bbc5-46636497cd5b tempest-GroupSnapshotsTest-602728984 None] Delete group completed successfully. Jun 15 07:28:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] group_snapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: deleting Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] group_snapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: deleting {{(pid=91865) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Deleting offline snapshot 7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 of volume d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] snapshot_file for this snap is: volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec5126-ebc6-4864-9392-a7866085b212]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:46 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:46 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:46 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.641s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.140s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,created_at=2026-06-15T05:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223104504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,host='devstack@QuobyteHD#QuobyteHD',id=c828ddf4-f740-458d-bf4c-63261645002f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:41Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d178a6-0cdd-4a36-8ff2-655a0341a90e),volume_type_id=17d178a6-0cdd-4a36-8ff2-655a0341a90e)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Creating volume c828ddf4-f740-458d-bf4c-63261645002f {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:46 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b673aa85-3954-4795-a84d-4167596e7fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aa5a73-069f-4ce3-a11b-eb2f4de66e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:46 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f 1073741824 Jun 15 07:28:46 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Volume volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 (f2a2b70a-713f-4d77-8a8d-3b8c33924a22): created successfully Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aa5a73-069f-4ce3-a11b-eb2f4de66e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (52e0b7fa-5609-4372-b72f-5ebd4c08c23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1553b03b-3e12-48da-9f7d-e909e3f3beb6 tempest-VolumesSnapshotTestJSON-843270261 None] Created volume successfully. Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:46 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:46 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Terminate volume connection completed successfully. Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:47 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 0.924s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece76fd-77ed-46c2-b321-e2f27d922927]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:47 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:47 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:47 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:47 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.814s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f 1073741824" returned: 0 in 1.042s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" by "detach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:47 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Detaching volume 96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 from instance 684c518d-eb3d-4ae6-a08d-f4b642028573. Jun 15 07:28:47 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f Jun 15 07:28:47 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:47 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Detach volume completed successfully. Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-561d850d-bbcc-4c71-8767-90b29888441c tempest-VolumesActionsTest-976706921 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:47 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 0.779s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:47 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:47 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75f6073d-d6de-4307-b279-9df5e8f40042 tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" by "detach_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75f6073d-d6de-4307-b279-9df5e8f40042 tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-75f6073d-d6de-4307-b279-9df5e8f40042 tempest-VolumesActionsTest-155708643 None] Volume detach called, but volume not attached. Jun 15 07:28:48 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f" returned: 0 in 0.668s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4194bfcc-a709-4626-b43b-3d810a4d1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c828ddf4-f740-458d-bf4c-63261645002f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d4922-8402-4f16-b92b-4cf070f991ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75f6073d-d6de-4307-b279-9df5e8f40042 tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Creating offline snapshot c850b771-c42b-4196-b709-eeb7f93c1599 of volume f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:28:48 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Volume volume-c828ddf4-f740-458d-bf4c-63261645002f (c828ddf4-f740-458d-bf4c-63261645002f): created successfully Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9d4922-8402-4f16-b92b-4cf070f991ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (18bd4f1b-7c73-41d1-8a64-38265b575dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf6979-a2b2-4c0d-b2aa-2e7344fef61e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d828e58a-29e5-42c5-8a12-f0e7ac4e54a7 tempest-GroupsTest-1850557751 None] Created volume successfully. Jun 15 07:28:48 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:28:48 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:48 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:48 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179 Jun 15 07:28:48 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-quobyte-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "cinder-quobyte-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ff23b7-e844-453a-bc84-5f033d48d779]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:49 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.900s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:49 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 Jun 15 07:28:49 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:49 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 1G Jun 15 07:28:49 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:49 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3.7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" returned: 0 in 0.820s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7c18b52d-39ba-46bc-8cbd-f44b2a8a8179" released by "_delete_snapshot" :: held 3.387s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" released by "delete_snapshot" :: held 3.421s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (1cfec3f3-1981-4650-ac8f-9d119d3bfe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03415c99-2e66-4427-b482-b3d86a94008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03415c99-2e66-4427-b482-b3d86a94008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117089382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,host='devstack@QuobyteHD#QuobyteHD',id=83a41cfa-9ed3-4432-9b57-45ef7a3311fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:49Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d178a6-0cdd-4a36-8ff2-655a0341a90e),volume_type_id=17d178a6-0cdd-4a36-8ff2-655a0341a90e)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27f406f-6afa-4f4f-bf3f-c64b9f3b32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27f406f-6afa-4f4f-bf3f-c64b9f3b32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc11c23b-2e9f-4d5b-a38d-95910665f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc11c23b-2e9f-4d5b-a38d-95910665f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83a41cfa-9ed3-4432-9b57-45ef7a3311fd', 'volume_name': 'volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583d4002-faf2-4fca-a7f6-e40048f2492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583d4002-faf2-4fca-a7f6-e40048f2492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484ab324-2ed4-4314-a461-a58fe0513dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Volume 83a41cfa-9ed3-4432-9b57-45ef7a3311fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd', 'volume_size': 1} Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:49 devstack cinder-volume[91865]: WARNING cinder.quota [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-301197317 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-301197317, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:28:49 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['97b9bc5f-5cd7-44ac-b6bf-cd707dd6bc35', 'fede0a3f-842e-485e-b2b9-41b325c83785', 'd65a409d-f9a5-4831-91d7-75e747890cae', 'c6442959-2998-41db-b2b8-9094ded2519f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f35a6d63-5ad3-41af-9a8e-253248478690 tempest-GroupSnapshotsTest-602728984 None] group_snapshot 5bf25722-1371-4f2e-9cb1-d6ef0f6a86cc: deleted successfully Jun 15 07:28:50 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" returned: 0 in 1.181s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:50 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17 Jun 15 07:28:50 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:50 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 1G" returned: 0 in 1.395s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:50 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:28:50 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" acquired by "delete_volume" :: waited 0.043s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e49475f-1865-4894-a4c4-de946fbb85f2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:50 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:50 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:50 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" returned: 0 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "cinder-quobyte-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17" released by "delete_volume" :: held 2.003s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Created reservations ['6c22aae6-0647-4a53-9aed-f0c4d9806884', 'f6fbacf9-b951-41fd-9b2e-253d214ea897', '0bd3756a-bf7c-4982-9764-5156a27f34eb', '0ccb20ee-1f6c-4820-ba45-ec48fd68532f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:51 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:51 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:51 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.856s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:51 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 is being set with open permissions: ugo+rw Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:51 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:28:51 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:51 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 0.977s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:51 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3 Jun 15 07:28:51 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:51 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.784s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:51 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Deleted volume successfully. Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e0858355-41eb-456f-b1c8-c4475335b7af tempest-VolumesActionsTest-155708643 None] Lock "cinder-96f14939-93c7-4bdb-9fc7-8c4cf5bf5e17-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:52 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.732s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:52 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info Jun 15 07:28:52 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:52 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d3f16812-aa4a-43b1-a9ee-3faceff31db3" returned: 0 in 0.699s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-d3f16812-aa4a-43b1-a9ee-3faceff31db3" released by "delete_volume" :: held 1.776s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['12ef83a2-3000-4184-8ea3-cfcc6325e7b1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:52 devstack cinder-volume[91865]: WARNING cinder.db.sqlalchemy.api [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-301197317'] Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['2647bb1a-cba5-4f2e-b1f5-5f1ac1eb4d62', 'cd391591-7174-4f85-8c9c-fdb5ae6067f5', '8fa10555-8cfa-4768-90d3-941637d86270', 'fb85e24e-8c3f-46ca-8959-967c6613aebd'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:52 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:28:52 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:52 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info" returned: 0 in 0.699s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:52 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info is being set with open permissions: ugo+rw Jun 15 07:28:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:52 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info Jun 15 07:28:52 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:53 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.726s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-87c92796-d524-401c-9e29-973e35a66935 tempest-GroupSnapshotsTest-602728984 None] Delete group completed successfully. Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9beab9c5-c017-4115-8899-a4857a380458 tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-2133376196: creating Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9beab9c5-c017-4115-8899-a4857a380458 tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-2133376196: created successfully Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9beab9c5-c017-4115-8899-a4857a380458 tempest-GroupSnapshotsTest-602728984 None] Create group completed successfully. Jun 15 07:28:53 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.info" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.577s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.945s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,created_at=2026-06-15T05:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117089382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4deec4a7-4e0e-44ce-9fe9-30ed3899d59b,host='devstack@QuobyteHD#QuobyteHD',id=83a41cfa-9ed3-4432-9b57-45ef7a3311fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d3f730d6374206b8235ea84290a911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:49Z,use_quota=True,user_id='28e7efc7829d491f9a154698ddd26fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17d178a6-0cdd-4a36-8ff2-655a0341a90e),volume_type_id=17d178a6-0cdd-4a36-8ff2-655a0341a90e)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Creating volume 83a41cfa-9ed3-4432-9b57-45ef7a3311fd {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:28:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:53 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd 1073741824 Jun 15 07:28:53 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-51dd030d-69f8-47e1-9396-e3a12dda460d tempest-VolumesSnapshotTestJSON-843270261 None] Create snapshot completed successfully Jun 15 07:28:54 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd 1073741824" returned: 0 in 0.865s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:54 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd Jun 15 07:28:54 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (b90eef5d-e7c4-4c3b-b55d-71c57c1e0195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d07a17f-1009-486d-a285-241fbca6a810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d07a17f-1009-486d-a285-241fbca6a810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1652470035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c664791c-4a5b-47a1-9ea7-42f9295b67c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e70403a96ad94474a0bf040c540740cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c850b771-c42b-4196-b709-eeb7f93c1599,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:55Z,use_quota=True,user_id='807ef41b73174fdea2c642979c9e130e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1ca15-2791-4c72-bc06-628fc87a1603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b1ca15-2791-4c72-bc06-628fc87a1603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23782daa-75f6-45f2-a183-0f9cba5fccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23782daa-75f6-45f2-a183-0f9cba5fccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c664791c-4a5b-47a1-9ea7-42f9295b67c5', 'volume_name': 'volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5', 'volume_size': 1, 'snapshot_id': 'c850b771-c42b-4196-b709-eeb7f93c1599'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d4ff36-7c52-4caf-b8e0-e6472304ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d4ff36-7c52-4caf-b8e0-e6472304ece5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3393af-65ce-44dd-98a4-675048c1ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Volume c664791c-4a5b-47a1-9ea7-42f9295b67c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5', 'volume_size': 1, 'snapshot_id': 'c850b771-c42b-4196-b709-eeb7f93c1599'} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (a47adbfd-c33a-48a9-9c6c-22c11ac41945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcd900b-997b-4a9e-9f9e-b59f1d78bfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcd900b-997b-4a9e-9f9e-b59f1d78bfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2107419652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,host='devstack@QuobyteHD#QuobyteHD',id=0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:55Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb48f17c-1ea4-47b0-aea4-8e891403dc79),volume_type_id=cb48f17c-1ea4-47b0-aea4-8e891403dc79)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77383591-9a43-403c-98ea-e2002ad87d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77383591-9a43-403c-98ea-e2002ad87d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce7aad6-a683-4196-85f0-3bf757dfb815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce7aad6-a683-4196-85f0-3bf757dfb815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a', 'volume_name': 'volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324b1c12-3938-491b-aa48-3915942b0c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324b1c12-3938-491b-aa48-3915942b0c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aea536d-3619-4a06-b56d-b740701809fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Volume 0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a', 'volume_size': 1} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:55 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" returned: 0 in 0.894s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.298s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599-c664791c-4a5b-47a1-9ea7-42f9295b67c5" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484ab324-2ed4-4314-a461-a58fe0513dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdb1e19-9c1c-4972-8902-2a3ef7d50be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599-c664791c-4a5b-47a1-9ea7-42f9295b67c5" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Creating volume c664791c-4a5b-47a1-9ea7-42f9295b67c5 from snapshot c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] snapshot: c850b771-c42b-4196-b709-eeb7f93c1599, volume: c664791c-4a5b-47a1-9ea7-42f9295b67c5, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:28:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Volume volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd (83a41cfa-9ed3-4432-9b57-45ef7a3311fd): created successfully Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdb1e19-9c1c-4972-8902-2a3ef7d50be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Flow 'volume_create_manager' (1cfec3f3-1981-4650-ac8f-9d119d3bfe5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:28:55 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-83d7daac-ea38-47ad-a876-e9337adf3ec6 tempest-GroupsTest-1850557751 None] Created volume successfully. Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53f3eaa-9d68-4f44-a00c-55fa8231b265]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:55 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:28:55 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:56 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.757s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[363419f3-85a7-420f-8aaf-e1598ad4025f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=155,cinder:DELETE=11,cinder:SELECT=143,cinder:INSERT=29 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:28:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=144,cinder:UPDATE=159,cinder:INSERT=42,cinder:DELETE=10 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:28:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-72baf41d-9348-4c12-8bc9-0ccff58bc597 tempest-GroupsTest-1850557751 None] Update group completed successfully. Jun 15 07:28:56 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:28:56 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:57 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jun 15 07:28:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.797s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:28:57 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:28:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:28:57 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 Jun 15 07:28:57 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:28:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-69c31164-458a-4c52-9c3c-ef1621ddcec7 tempest-GroupsTest-1850557751 None] Update group completed successfully. Jun 15 07:28:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Acquiring lock "cinder-quobyte-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:28:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:28:59 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7811157f-2183-4efb-898d-58a6e4aaeb64]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:28:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:00 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd Jun 15 07:29:00 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:01 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" returned: 0 in 1.804s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:01 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd Jun 15 07:29:01 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:01 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (23b4a043-a710-4202-9d11-07b7a84b8813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e4e6b2-73d2-4dc4-9edf-07c52ba0b7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e4e6b2-73d2-4dc4-9edf-07c52ba0b7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784129968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1056cd2c-fb5d-4f20-af94-e9aabf54dde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:02Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6845c1d-afc2-4259-bd0d-079e9d6ab46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6845c1d-afc2-4259-bd0d-079e9d6ab46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d11bec8-226b-4dd4-81ec-60e7cbd444c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d11bec8-226b-4dd4-81ec-60e7cbd444c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1056cd2c-fb5d-4f20-af94-e9aabf54dde4', 'volume_name': 'volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b28d689-ca6a-425c-a8f0-f7727f97501e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b28d689-ca6a-425c-a8f0-f7727f97501e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f204bf-53d5-4ace-a707-0c82d3d7caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Volume 1056cd2c-fb5d-4f20-af94-e9aabf54dde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4', 'volume_size': 1} Jun 15 07:29:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:03 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" returned: 0 in 1.284s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-83a41cfa-9ed3-4432-9b57-45ef7a3311fd" released by "delete_volume" :: held 3.198s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Acquiring lock "cinder-quobyte-c828ddf4-f740-458d-bf4c-63261645002f" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-c828ddf4-f740-458d-bf4c-63261645002f" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f94a4f-b0fa-4ca5-b669-266e81c1d4a7]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:03 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5" returned: 0 in 5.859s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca147a-dbdb-4009-b756-2e7a5bf8651e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:03 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f Jun 15 07:29:03 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:03 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:29:03 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:03 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f" returned: 0 in 0.693s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:03 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f Jun 15 07:29:03 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:04 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.909s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:29:04 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Converted 1024.00 MB image at 174.75 MB/s Jun 15 07:29:04 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 is being set with open permissions: ugo+rw Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:04 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 Jun 15 07:29:04 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:04 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c828ddf4-f740-458d-bf4c-63261645002f" returned: 0 in 0.624s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "cinder-quobyte-c828ddf4-f740-458d-bf4c-63261645002f" released by "delete_volume" :: held 1.359s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Created reservations ['903378c0-9cca-4adf-84ab-4275c965921c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:04 devstack cinder-volume[91865]: WARNING cinder.quota [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1940288419 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1940288419, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:04 devstack cinder-volume[91865]: WARNING cinder.quota [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1940288419 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1940288419, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Created reservations ['f07c45ff-78a7-407a-a61b-89db5d8e31f1', '530576bf-a505-44ea-bb30-d4aaefa84704', '28221471-77ca-4d58-9354-35a3be57fdcd', '86dfff6f-75fe-46f1-b2d6-7d2b85b06b77'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:04 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Created reservations ['520f8fca-c684-4fcd-be5c-bd67a2a38bdd', 'fed5b504-0044-4aaa-a31e-d9f32d5c8a59', 'c094f9ef-4ab4-48c2-8cd5-516a603d8554', 'd75877c9-fc1d-46c7-9e78-7aced0d5b3bb'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5" returned: 0 in 0.629s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" released by "_copy_volume_from_snapshot" :: held 9.108s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599-c664791c-4a5b-47a1-9ea7-42f9295b67c5" released by "_create_volume_from_snapshot" :: held 9.153s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.197s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.265s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,created_at=2026-06-15T05:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2107419652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,host='devstack@QuobyteHD#QuobyteHD',id=0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:28:55Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb48f17c-1ea4-47b0-aea4-8e891403dc79),volume_type_id=cb48f17c-1ea4-47b0-aea4-8e891403dc79)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Creating volume 0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:04 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:04 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a 1073741824 Jun 15 07:29:04 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3393af-65ce-44dd-98a4-675048c1ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5', 'volume_size': 1, 'snapshot_id': 'c850b771-c42b-4196-b709-eeb7f93c1599'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08596d19-60f9-433c-9e08-69b35f144bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Volume volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 (c664791c-4a5b-47a1-9ea7-42f9295b67c5): created successfully Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08596d19-60f9-433c-9e08-69b35f144bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Flow 'volume_create_manager' (b90eef5d-e7c4-4c3b-b55d-71c57c1e0195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:04 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ac9b27d5-0089-48f4-9f69-f0c42de8f54c tempest-VolumesSnapshotTestJSON-843270261 None] Created volume successfully. Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:04 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:04 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-c664791c-4a5b-47a1-9ea7-42f9295b67c5-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-c664791c-4a5b-47a1-9ea7-42f9295b67c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f500d078-e56b-4315-abd5-e6f44c03d5b1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:05 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 Jun 15 07:29:05 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:05 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.661s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:05 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6618366f-3e6b-4632-8b9b-6fecafce33bf tempest-GroupsTest-1850557751 None] Delete group completed successfully. Jun 15 07:29:05 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a 1073741824" returned: 0 in 0.870s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:05 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a Jun 15 07:29:05 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:06 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5" returned: 0 in 0.780s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:06 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5 Jun 15 07:29:06 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:06 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" returned: 0 in 0.619s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.211s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1784129968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1056cd2c-fb5d-4f20-af94-e9aabf54dde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:02Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Creating volume 1056cd2c-fb5d-4f20-af94-e9aabf54dde4 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:06 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aea536d-3619-4a06-b56d-b740701809fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:06 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 1073741824 Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaea933-3977-4232-bca8-d6b693032021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:06 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Volume volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a (0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a): created successfully Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaea933-3977-4232-bca8-d6b693032021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (a47adbfd-c33a-48a9-9c6c-22c11ac41945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d02b37c3-adc9-496d-8102-530dbc500f2b tempest-GroupSnapshotsTest-602728984 None] Created volume successfully. Jun 15 07:29:06 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c664791c-4a5b-47a1-9ea7-42f9295b67c5" returned: 0 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c664791c-4a5b-47a1-9ea7-42f9295b67c5" released by "delete_volume" :: held 1.518s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['4d705f51-1e59-4e60-8ac9-82b4bbe7609f', '0896243a-6fa1-4353-bf6e-f822cc9ba257', 'f4b8e73c-23d3-47f5-9306-1e0f968b94cc', 'c63ff528-70cc-4d2a-bab1-800d6663c88e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:06 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:06 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:07 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 1073741824" returned: 0 in 1.101s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (1792fefb-ccc6-4cd7-9776-c3b3564b2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7bd8e0-a624-4ff1-ba36-754804c1766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7bd8e0-a624-4ff1-ba36-754804c1766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903865243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,host='devstack@QuobyteHD#QuobyteHD',id=bfa39ebd-9431-4042-8e1a-cffa6016b942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:07Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb48f17c-1ea4-47b0-aea4-8e891403dc79),volume_type_id=cb48f17c-1ea4-47b0-aea4-8e891403dc79)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab5deb-ac39-4e7c-bbf3-ee88f910067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab5deb-ac39-4e7c-bbf3-ee88f910067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ba3f22-054f-4e1c-a5f7-b48bf5116208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ba3f22-054f-4e1c-a5f7-b48bf5116208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa39ebd-9431-4042-8e1a-cffa6016b942', 'volume_name': 'volume-bfa39ebd-9431-4042-8e1a-cffa6016b942', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b39de7-1935-45ce-a3d5-9bd0bf25ede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b39de7-1935-45ce-a3d5-9bd0bf25ede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b7127c-693f-49d5-820f-bde36b88bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Volume bfa39ebd-9431-4042-8e1a-cffa6016b942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa39ebd-9431-4042-8e1a-cffa6016b942', 'volume_size': 1} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-c850b771-c42b-4196-b709-eeb7f93c1599-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-c850b771-c42b-4196-b709-eeb7f93c1599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:07 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 Jun 15 07:29:07 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Deleting offline snapshot c850b771-c42b-4196-b709-eeb7f93c1599 of volume f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] snapshot_file for this snap is: volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa0a26-99ba-48d1-8071-848ff7ea2db4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:07 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Deleted volume successfully. Jun 15 07:29:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-17ccc45a-a906-478e-9f72-9f39d3a0eae5 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-c664791c-4a5b-47a1-9ea7-42f9295b67c5-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:07 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:29:07 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:08 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" returned: 0 in 0.757s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,created_at=2026-06-15T05:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903865243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a8b69c-f9c9-45d8-b510-b4b00cbacc2c,host='devstack@QuobyteHD#QuobyteHD',id=bfa39ebd-9431-4042-8e1a-cffa6016b942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:07Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb48f17c-1ea4-47b0-aea4-8e891403dc79),volume_type_id=cb48f17c-1ea4-47b0-aea4-8e891403dc79)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Creating volume bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:08 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:08 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 1073741824 Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f204bf-53d5-4ace-a707-0c82d3d7caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:08 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dc6971-2d12-4a74-91cb-565879abee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Volume volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 (1056cd2c-fb5d-4f20-af94-e9aabf54dde4): created successfully Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dc6971-2d12-4a74-91cb-565879abee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (23b4a043-a710-4202-9d11-07b7a84b8813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ae5e6abb-7e04-4d7d-aec2-829c0359a289 tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:29:08 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4818f92-f333-4476-afc9-5f338333133d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:08 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:29:08 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:09 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 1073741824" returned: 0 in 0.869s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:09 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 Jun 15 07:29:09 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:09 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.859s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:09 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:29:09 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-1056cd2c-fb5d-4f20-af94-e9aabf54dde4-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "cinder-1056cd2c-fb5d-4f20-af94-e9aabf54dde4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-quobyte-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20fb5fd-980f-4582-bb76-a0b737a20474]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:09 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:09 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942" returned: 0 in 0.653s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:09 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b7127c-693f-49d5-820f-bde36b88bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa39ebd-9431-4042-8e1a-cffa6016b942', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a75334-184b-45a9-85f6-48df34c7b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:09 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Volume volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 (bfa39ebd-9431-4042-8e1a-cffa6016b942): created successfully Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a75334-184b-45a9-85f6-48df34c7b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (1792fefb-ccc6-4cd7-9776-c3b3564b2b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-082fdea9-a8a1-4fff-8f77-4a697aae50e3 tempest-GroupSnapshotsTest-602728984 None] Created volume successfully. Jun 15 07:29:10 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.894s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:10 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599 Jun 15 07:29:10 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:10 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" returned: 0 in 0.810s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:10 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4 Jun 15 07:29:10 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d1814461-baff-4116-9c60-e1e31b03fe38 tempest-GroupSnapshotsTest-602728984 None] Update group completed successfully. Jun 15 07:29:11 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22.c850b771-c42b-4196-b709-eeb7f93c1599" returned: 0 in 0.775s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-c850b771-c42b-4196-b709-eeb7f93c1599" released by "_delete_snapshot" :: held 3.491s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" released by "delete_snapshot" :: held 3.523s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['2e558ae6-6af3-4d1e-b620-b259aaa1c68e', '1eac1b88-8da6-4d58-b975-46f4ef6a3ebd', '286022b4-ca0a-4248-b152-b0a85a1a1941', 'af527eb7-4e63-459a-ac54-6cd477aa4d98'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Delete snapshot completed successfully. Jun 15 07:29:11 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a70aa38-6dc2-40a7-aaf7-d387d8b89d11 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-c850b771-c42b-4196-b709-eeb7f93c1599-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" returned: 0 in 0.697s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-1056cd2c-fb5d-4f20-af94-e9aabf54dde4" released by "delete_volume" :: held 1.556s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Created reservations ['54656e0f-3c78-4018-bfe5-c5870a63e9a5', '83622648-15e6-43f4-b9a2-139f0a167135', 'f4dd6166-05d6-4109-93ab-f69110a2b574', '1e154fe1-2d87-4638-9e2f-daf19741074f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:11 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:11 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-f2a2b70a-713f-4d77-8a8d-3b8c33924a22-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-f2a2b70a-713f-4d77-8a8d-3b8c33924a22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" acquired by "delete_volume" :: waited 0.036s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d715be6c-34e3-4282-afac-37d57afa41d2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:12 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.677s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Deleted volume successfully. Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-77f1b311-ae6a-4eb4-80b5-319ad1eb33d9 tempest-VolumesActionsTest-976706921 None] Lock "cinder-1056cd2c-fb5d-4f20-af94-e9aabf54dde4-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:12 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:29:12 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Flow 'volume_create_manager' (70a608c8-8a62-4020-aa56-da858103023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb630df2-5b55-40f3-917c-89c8e785b85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb630df2-5b55-40f3-917c-89c8e785b85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1273879323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ec807d-b0b2-4410-901e-8445ad73bc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474fbebf0f55479995111826e3ab51e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:12Z,use_quota=True,user_id='87423ce7511d4f56a7f6236320297f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41339c1-6956-480b-8d9c-a6d71fd25a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41339c1-6956-480b-8d9c-a6d71fd25a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2edf47d-464f-43cc-889f-82e4a7c6a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2edf47d-464f-43cc-889f-82e4a7c6a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ec807d-b0b2-4410-901e-8445ad73bc13', 'volume_name': 'volume-17ec807d-b0b2-4410-901e-8445ad73bc13', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe9d84-5c39-4654-a175-21c23b7b1d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbe9d84-5c39-4654-a175-21c23b7b1d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c23a3c-23ad-421b-9e91-d1bb86c2d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Volume 17ec807d-b0b2-4410-901e-8445ad73bc13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ec807d-b0b2-4410-901e-8445ad73bc13', 'volume_size': 1} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1273879323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ec807d-b0b2-4410-901e-8445ad73bc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474fbebf0f55479995111826e3ab51e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:12Z,use_quota=True,user_id='87423ce7511d4f56a7f6236320297f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Creating volume 17ec807d-b0b2-4410-901e-8445ad73bc13 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e300d83b-afd1-4306-83b5-f765af6597d0 tempest-GroupSnapshotsTest-602728984 None] Update group completed successfully. Jun 15 07:29:12 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 1073741824 Jun 15 07:29:12 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (b20b60ad-1a6c-4326-b6aa-1567aadc7f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c30f72-ff6d-4b27-96b3-11ae8c6d1af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c30f72-ff6d-4b27-96b3-11ae8c6d1af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877411286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d4f37-a4a8-4daf-8feb-234ac05bebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:13Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eaa11e-238f-4c94-a4a2-b82396e34280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eaa11e-238f-4c94-a4a2-b82396e34280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7096af9-e962-4728-9f57-7f6ba71e7ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7096af9-e962-4728-9f57-7f6ba71e7ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07d4f37-a4a8-4daf-8feb-234ac05bebe7', 'volume_name': 'volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8302e93f-c924-4e31-a469-0c1d8819682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8302e93f-c924-4e31-a469-0c1d8819682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75111b66-8f94-4db8-be19-d902907315f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Volume c07d4f37-a4a8-4daf-8feb-234ac05bebe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7', 'volume_size': 1} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:12 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.775s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:12 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22 Jun 15 07:29:12 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:13 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 1073741824" returned: 0 in 0.832s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:13 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 Jun 15 07:29:13 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-31ce531f-32d4-487e-a9dd-cd8c77110d03 tempest-GroupSnapshotsTest-602728984 None] Update group completed successfully. Jun 15 07:29:13 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" returned: 0 in 0.642s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-f2a2b70a-713f-4d77-8a8d-3b8c33924a22" released by "delete_volume" :: held 1.525s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['66c575f6-8d88-47b3-ad35-b338421e047d', '8b5f99b0-f28d-4f1d-b1ba-23bbd700baf0', 'c0800e73-07f8-4c23-be46-b810295ac160', '5bb333e9-47fb-4b5f-9710-e366b0c42971'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:13 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:13 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:13 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877411286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07d4f37-a4a8-4daf-8feb-234ac05bebe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:13Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Creating volume c07d4f37-a4a8-4daf-8feb-234ac05bebe7 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:13 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c23a3c-23ad-421b-9e91-d1bb86c2d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ec807d-b0b2-4410-901e-8445ad73bc13', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:13 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 1073741824 Jun 15 07:29:13 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebea7238-106a-4ebf-b4a8-4ece4ba8e3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Volume volume-17ec807d-b0b2-4410-901e-8445ad73bc13 (17ec807d-b0b2-4410-901e-8445ad73bc13): created successfully Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebea7238-106a-4ebf-b4a8-4ece4ba8e3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Flow 'volume_create_manager' (70a608c8-8a62-4020-aa56-da858103023f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-91c217de-f189-434b-bd31-409e0bd31068 tempest-VolumesServicesTestJSON-1770079985 None] Created volume successfully. Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-525ea230-19c9-48f9-9c8b-b4b15d3d4359-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-525ea230-19c9-48f9-9c8b-b4b15d3d4359-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:14 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.688s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Deleted volume successfully. Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4429709c-77c4-4566-bf6c-7705ffcb5278]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-20f1e814-15d6-4c4e-a1bf-fc74617405a2 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-f2a2b70a-713f-4d77-8a8d-3b8c33924a22-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:14 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 Jun 15 07:29:14 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Acquiring lock "cinder-17ec807d-b0b2-4410-901e-8445ad73bc13-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "cinder-17ec807d-b0b2-4410-901e-8445ad73bc13-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Acquiring lock "cinder-quobyte-17ec807d-b0b2-4410-901e-8445ad73bc13" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "cinder-quobyte-17ec807d-b0b2-4410-901e-8445ad73bc13" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580b0e0-5620-43ad-a158-b8e852ea89ad]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ae8d7f4f-8fdd-4691-9db9-ff911261b4e7 tempest-GroupSnapshotsTest-602728984 None] Update group completed successfully. Jun 15 07:29:14 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 Jun 15 07:29:14 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:14 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 1073741824" returned: 0 in 0.947s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:14 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 Jun 15 07:29:14 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:15 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359" returned: 0 in 0.808s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:15 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359 Jun 15 07:29:15 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:15 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13" returned: 0 in 0.754s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:15 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13 Jun 15 07:29:15 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:15 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" returned: 0 in 0.641s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75111b66-8f94-4db8-be19-d902907315f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca9a75a-6fca-4462-9521-0cf0ade9f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Volume volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 (c07d4f37-a4a8-4daf-8feb-234ac05bebe7): created successfully Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fca9a75a-6fca-4462-9521-0cf0ade9f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (b20b60ad-1a6c-4326-b6aa-1567aadc7f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-21bcacf0-0d3a-45a5-8631-40623ad230f7 tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:29:15 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-525ea230-19c9-48f9-9c8b-b4b15d3d4359" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-quobyte-525ea230-19c9-48f9-9c8b-b4b15d3d4359" released by "delete_volume" :: held 1.597s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Created reservations ['c510856f-5973-4dcd-a374-a456f1b65f3b', 'd3c72935-6c6a-4186-b0c1-851e2de25659', '21370244-7bda-4826-99f5-356a2b88590d', '9c79f28c-a459-47e8-b062-3f1d4cfde1a7'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-c07d4f37-a4a8-4daf-8feb-234ac05bebe7-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "cinder-c07d4f37-a4a8-4daf-8feb-234ac05bebe7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-quobyte-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:16 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:16 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b56e6-4715-49b9-b255-83fd6216bbbd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:16 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-17ec807d-b0b2-4410-901e-8445ad73bc13" returned: 0 in 0.795s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] GroupSnapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: creating. Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "cinder-quobyte-17ec807d-b0b2-4410-901e-8445ad73bc13" released by "delete_volume" :: held 1.621s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Group snapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: creating. {{(pid=91865) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Creating offline snapshot 353cf586-94bc-4bb3-80bf-8e44f34ef2b2 of volume 0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7278f-6223-4768-8e2d-f2ba2fd1bb53]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:16 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 Jun 15 07:29:16 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Created reservations ['f554a6f2-f60e-48da-98fb-455be17b39b0', '7978880d-c73a-4d21-9ae7-5a78d827c272', '450e1df8-fb6c-4ae8-b94e-ca49ff78cdbe', 'b86fb7a9-962d-4794-bfdd-96ffd8c89962'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:16 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a Jun 15 07:29:16 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:16 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:16 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:16 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.907s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Deleted volume successfully. Jun 15 07:29:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c6778529-0fe3-44a7-9904-bd31d1b1ee70 tempest-VolumesSnapshotTestJSON-843270261 None] Lock "cinder-525ea230-19c9-48f9-9c8b-b4b15d3d4359-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:17 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" returned: 0 in 0.938s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:17 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7 Jun 15 07:29:17 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:17 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" returned: 0 in 0.937s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:17 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 1G Jun 15 07:29:17 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:17 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.049s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:17 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Deleted volume successfully. Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-75c6324b-4331-4849-8976-c23670f1f98c tempest-VolumesServicesTestJSON-1770079985 None] Lock "cinder-17ec807d-b0b2-4410-901e-8445ad73bc13-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:17 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" returned: 0 in 0.838s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-c07d4f37-a4a8-4daf-8feb-234ac05bebe7" released by "delete_volume" :: held 1.833s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:17 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Created reservations ['530aa56c-55aa-45f8-ab44-80dfa2d1fad6', '2f6f4acc-7b8b-4b30-b478-f075ce090eb8', '37907303-32d6-4f00-a2ac-cf3014a98289', '155fe355-0254-41eb-a4a7-ca7a1588b1ef'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:18 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:18 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:18 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 1G" returned: 0 in 1.071s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:18 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 Jun 15 07:29:18 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:18 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:18 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:18 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Deleted volume successfully. Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eada6558-806c-4f5c-bc3c-384e018edf01 tempest-VolumesActionsTest-976706921 None] Lock "cinder-c07d4f37-a4a8-4daf-8feb-234ac05bebe7-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (73626ff2-dc3d-406d-ae44-ad9527ce96fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6e112f-e261-4cd5-aa8e-f77139906202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6e112f-e261-4cd5-aa8e-f77139906202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814469292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da1679e-0709-434c-b587-b2861426dc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:19Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1d7368-38dc-4d53-af8b-4a453d6c583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1d7368-38dc-4d53-af8b-4a453d6c583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4f446-9be7-4420-a5c9-28b51103b964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a4f446-9be7-4420-a5c9-28b51103b964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da1679e-0709-434c-b587-b2861426dc08', 'volume_name': 'volume-8da1679e-0709-434c-b587-b2861426dc08', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cda7c18-0999-4965-a532-af37efa2d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cda7c18-0999-4965-a532-af37efa2d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f54744f-4350-4417-8169-f5a8e5e10a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:19 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Volume 8da1679e-0709-434c-b587-b2861426dc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da1679e-0709-434c-b587-b2861426dc08', 'volume_size': 1} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:19 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2" returned: 0 in 0.923s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:19 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:19 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 Jun 15 07:29:19 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:19 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2" returned: 0 in 0.648s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:19 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info Jun 15 07:29:19 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:20 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:20 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:20 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info Jun 15 07:29:20 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:21 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.info" returned: 0 in 0.690s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.050s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Creating offline snapshot a32d632f-e5b4-4388-89a9-b245d7b5d646 of volume bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f644122-3801-4e14-943d-3a24b5c2b0af]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:21 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 Jun 15 07:29:21 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:22 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942" returned: 0 in 0.811s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:22 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 1G Jun 15 07:29:22 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:23 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 1G" returned: 0 in 0.880s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:23 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 Jun 15 07:29:23 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:23 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646" returned: 0 in 0.748s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:23 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:23 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 Jun 15 07:29:23 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:24 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646" returned: 0 in 0.680s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:24 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info Jun 15 07:29:24 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:25 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info" returned: 0 in 0.746s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:25 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:25 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info Jun 15 07:29:25 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:25 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.info" returned: 0 in 0.699s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.836s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1814469292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da1679e-0709-434c-b587-b2861426dc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:19Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Creating volume 8da1679e-0709-434c-b587-b2861426dc08 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:25 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:25 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 1073741824 Jun 15 07:29:25 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0f24eb5c-a84e-4c18-9e5f-cad6ef0d99f4 tempest-GroupSnapshotsTest-602728984 None] group_snapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: created successfully Jun 15 07:29:26 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 1073741824" returned: 0 in 0.935s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] group_snapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: deleting Jun 15 07:29:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] group_snapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: deleting {{(pid=91865) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:27 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 Jun 15 07:29:27 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-353cf586-94bc-4bb3-80bf-8e44f34ef2b2" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-353cf586-94bc-4bb3-80bf-8e44f34ef2b2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Deleting offline snapshot 353cf586-94bc-4bb3-80bf-8e44f34ef2b2 of volume 0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] snapshot_file for this snap is: volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[950127af-6614-493c-9044-57671f4e4371]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:27 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 Jun 15 07:29:27 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:27 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08" returned: 0 in 0.900s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f54744f-4350-4417-8169-f5a8e5e10a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da1679e-0709-434c-b587-b2861426dc08', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a625e74a-297a-41c6-979e-a7c1578f2f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:27 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Volume volume-8da1679e-0709-434c-b587-b2861426dc08 (8da1679e-0709-434c-b587-b2861426dc08): created successfully Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a625e74a-297a-41c6-979e-a7c1578f2f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (73626ff2-dc3d-406d-ae44-ad9527ce96fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8b5caaa0-9a7d-419a-987d-2c269e6fcfad tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:29:28 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2" returned: 0 in 0.992s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4322097-b67f-44ca-b404-ce57f8d200f9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:28 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a Jun 15 07:29:28 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-8da1679e-0709-434c-b587-b2861426dc08-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "cinder-8da1679e-0709-434c-b587-b2861426dc08-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:29 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-quobyte-8da1679e-0709-434c-b587-b2861426dc08" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" returned: 0 in 0.851s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-8da1679e-0709-434c-b587-b2861426dc08" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:29 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 Jun 15 07:29:29 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d043a6-90f9-4c11-a93f-a00fbcc43743]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:29 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 Jun 15 07:29:29 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:30 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2" returned: 0 in 0.981s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:30 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2 Jun 15 07:29:30 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:30 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08" returned: 0 in 1.079s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:30 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08 Jun 15 07:29:30 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:30 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a.353cf586-94bc-4bb3-80bf-8e44f34ef2b2" returned: 0 in 0.761s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-353cf586-94bc-4bb3-80bf-8e44f34ef2b2" released by "_delete_snapshot" :: held 3.729s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" released by "delete_snapshot" :: held 3.759s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-a32d632f-e5b4-4388-89a9-b245d7b5d646" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-a32d632f-e5b4-4388-89a9-b245d7b5d646" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Deleting offline snapshot a32d632f-e5b4-4388-89a9-b245d7b5d646 of volume bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] snapshot_file for this snap is: volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:29:30 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8da1679e-0709-434c-b587-b2861426dc08" returned: 0 in 0.797s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7b36c0-fdff-4cff-826f-361f52fe37bb]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-8da1679e-0709-434c-b587-b2861426dc08" released by "delete_volume" :: held 1.947s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Created reservations ['da5f2993-fc5f-4900-823f-316c77c6159b', 'e499d471-d8d4-44a5-948f-8aacc88e1302', '8660c4a9-d69c-46d7-9ed2-e573ff1f789b', 'e253dd82-e78b-48d0-bf10-6427e059c410'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:31 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 Jun 15 07:29:31 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:31 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:31 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (edfdc53a-fdf1-40ec-887c-314ce7d8ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9e07d6-dc10-4438-bd00-af0da27fa889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9e07d6-dc10-4438-bd00-af0da27fa889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1920120807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba945ba-8249-4870-b72a-4a1567e75430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:32Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b562ca-b2a0-4b89-b837-6fe6ba385593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b562ca-b2a0-4b89-b837-6fe6ba385593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45f50db-df7f-4654-8d14-679534f0b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45f50db-df7f-4654-8d14-679534f0b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ba945ba-8249-4870-b72a-4a1567e75430', 'volume_name': 'volume-2ba945ba-8249-4870-b72a-4a1567e75430', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba99c8c8-c0de-4d31-830f-2cad1dbae157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba99c8c8-c0de-4d31-830f-2cad1dbae157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d611fb7-ab67-4cd8-800e-cf58952c28fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Volume 2ba945ba-8249-4870-b72a-4a1567e75430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ba945ba-8249-4870-b72a-4a1567e75430', 'volume_size': 1} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1920120807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ba945ba-8249-4870-b72a-4a1567e75430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:32Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Creating volume 2ba945ba-8249-4870-b72a-4a1567e75430 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:32 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:32 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 1073741824 Jun 15 07:29:32 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:32 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.989s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Deleted volume successfully. Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60b19164-f788-4ace-a9b2-e8559dfd2696 tempest-VolumesActionsTest-976706921 None] Lock "cinder-8da1679e-0709-434c-b587-b2861426dc08-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:32 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646" returned: 0 in 1.276s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfa39ebd-9431-4042-8e1a-cffa6016b942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f7186-e76b-46c1-a39f-e2311088705a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:32 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 Jun 15 07:29:32 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:33 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 1073741824" returned: 0 in 1.178s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:33 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 Jun 15 07:29:33 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:33 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942" returned: 0 in 1.171s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:33 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 Jun 15 07:29:33 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:34 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430" returned: 0 in 0.871s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d611fb7-ab67-4cd8-800e-cf58952c28fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ba945ba-8249-4870-b72a-4a1567e75430', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95463712-1a9c-4f2a-b71c-dc0db6ee6460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Volume volume-2ba945ba-8249-4870-b72a-4a1567e75430 (2ba945ba-8249-4870-b72a-4a1567e75430): created successfully Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95463712-1a9c-4f2a-b71c-dc0db6ee6460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (edfdc53a-fdf1-40ec-887c-314ce7d8ca90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d4421c9a-f674-426d-8ae3-9a4179723dad tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:29:34 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646" returned: 0 in 0.899s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:34 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646 Jun 15 07:29:34 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:35 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942.a32d632f-e5b4-4388-89a9-b245d7b5d646" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-a32d632f-e5b4-4388-89a9-b245d7b5d646" released by "_delete_snapshot" :: held 4.216s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" released by "delete_snapshot" :: held 4.252s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:35 devstack cinder-volume[91865]: WARNING cinder.quota [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-926134928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-926134928, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:35 devstack cinder-volume[91865]: WARNING cinder.quota [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-926134928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-926134928, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Created reservations ['46d0c99a-b127-4f1b-b131-2d4078f68ac9', 'b0fbae13-7bce-425b-995d-0e9f91a858ce', '085e1362-8462-4110-bce8-a7147c38fecc', '6d4dd19c-dec9-42df-a9ac-842fd61da6e8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-2ba945ba-8249-4870-b72a-4a1567e75430-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] Created reservations ['296255c6-b7f8-4bfe-b58c-d6a5a91451f1', '2a510805-30a2-4feb-b343-277cea02919f', 'ddb0d1eb-4f97-4c6b-a5e5-d5f3c0cff04e', '62cb754d-fa45-458e-b599-ab1363cf932a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "cinder-2ba945ba-8249-4870-b72a-4a1567e75430-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Acquiring lock "cinder-quobyte-2ba945ba-8249-4870-b72a-4a1567e75430" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-2ba945ba-8249-4870-b72a-4a1567e75430" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-143df9c9-4501-4539-a181-69cb0b15d29d tempest-GroupSnapshotsTest-602728984 None] group_snapshot ef69bb40-ed18-472e-bd09-cbdef9ece124: deleted successfully Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a1f4bb-d44b-4887-b3d9-56d38a3b92dd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:35 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 Jun 15 07:29:35 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ded82f-b418-45c4-816b-c813639a3763]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:36 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a Jun 15 07:29:36 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:36 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430" returned: 0 in 0.983s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:36 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430 Jun 15 07:29:36 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:37 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" returned: 0 in 0.987s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:37 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:37 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a Jun 15 07:29:37 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2ba945ba-8249-4870-b72a-4a1567e75430" returned: 0 in 0.750s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "cinder-quobyte-2ba945ba-8249-4870-b72a-4a1567e75430" released by "delete_volume" :: held 1.801s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Created reservations ['fadc7d5e-24d1-44da-b2b1-45c012a2f2d3', 'edff31d1-11cd-47cd-b369-6da4f11c80de', '45a3e0c4-8d31-4b1c-95a2-2395a2620d43', '7f575137-4d2b-4ed3-8e46-5cbdca72aefc'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:37 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:37 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (8d86a7b4-50d4-4f1b-a916-9e3e1cccb260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9783c71a-0af3-4672-8e5c-c12c7c4ca143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9783c71a-0af3-4672-8e5c-c12c7c4ca143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221398424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b88a5-0779-40c0-9974-9d3c62ac04b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:38Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58011a52-4149-4154-85ae-661d57b368aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58011a52-4149-4154-85ae-661d57b368aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a1454-08f6-4865-b89e-bb62fb108b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a1454-08f6-4865-b89e-bb62fb108b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a7b88a5-0779-40c0-9974-9d3c62ac04b2', 'volume_name': 'volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d921ef-78cf-4385-ac39-421265c4e339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d921ef-78cf-4385-ac39-421265c4e339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecff7f71-086d-42a1-9ebf-6590df5cb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Volume 8a7b88a5-0779-40c0-9974-9d3c62ac04b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2', 'volume_size': 1} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-221398424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a7b88a5-0779-40c0-9974-9d3c62ac04b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:38Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Creating volume 8a7b88a5-0779-40c0-9974-9d3c62ac04b2 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:37 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:37 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 1073741824 Jun 15 07:29:37 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:38 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.855s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Deleted volume successfully. Jun 15 07:29:38 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-26666be4-f5f8-48c4-a2c9-7c7e673cfeb7 tempest-VolumesActionsTest-976706921 None] Lock "cinder-2ba945ba-8249-4870-b72a-4a1567e75430-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" returned: 0 in 1.181s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (f0abd085-f425-4ad0-9505-9ba9e960caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4fa69a-afd0-42b6-8397-ff0ed0f6087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-0ab62c4a-f36d-4fe5-b030-3ee4f6ae1a6a" released by "delete_volume" :: held 2.297s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4fa69a-afd0-42b6-8397-ff0ed0f6087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436367577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe65916-6f30-4ff4-92a8-f81c8d191598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:38Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289243e-a7d1-48ae-bfd7-a98a320f22ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289243e-a7d1-48ae-bfd7-a98a320f22ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da96db8-5af1-465d-a2e0-8fd80938d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da96db8-5af1-465d-a2e0-8fd80938d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe65916-6f30-4ff4-92a8-f81c8d191598', 'volume_name': 'volume-1fe65916-6f30-4ff4-92a8-f81c8d191598', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59264443-aa0b-4d61-8597-1c89916f20ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59264443-aa0b-4d61-8597-1c89916f20ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa7d455-e5d5-484a-949b-20029ba186d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:38 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Volume 1fe65916-6f30-4ff4-92a8-f81c8d191598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe65916-6f30-4ff4-92a8-f81c8d191598', 'volume_size': 1} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" acquired by "delete_volume" :: waited 0.064s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b81233-49c4-4a86-b5d3-70258dd0fd8a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:38 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 1073741824" returned: 0 in 0.933s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:38 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 Jun 15 07:29:38 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:38 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 Jun 15 07:29:38 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:39 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:39 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942 Jun 15 07:29:39 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:39 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" returned: 0 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1436367577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe65916-6f30-4ff4-92a8-f81c8d191598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3653a58343b1466496a5a34666a8b497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:38Z,use_quota=True,user_id='d11bf5fda1b94b0da44bc4ce470cc59e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Creating volume 1fe65916-6f30-4ff4-92a8-f81c8d191598 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:39 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecff7f71-086d-42a1-9ebf-6590df5cb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:39 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 1073741824 Jun 15 07:29:39 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad3a445-6725-4f22-abce-c28bd8093018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:39 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Volume volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 (8a7b88a5-0779-40c0-9974-9d3c62ac04b2): created successfully Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad3a445-6725-4f22-abce-c28bd8093018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (8d86a7b4-50d4-4f1b-a916-9e3e1cccb260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c65c516b-40a3-41cd-a467-0a16bbe1082b tempest-VolumesListAdminTestJSON-1705674843 None] Created volume successfully. Jun 15 07:29:40 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bfa39ebd-9431-4042-8e1a-cffa6016b942" returned: 0 in 0.827s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-bfa39ebd-9431-4042-8e1a-cffa6016b942" released by "delete_volume" :: held 1.642s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Created reservations ['93b193b5-9d4f-478f-871d-a6aec3498e6a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (1a552090-f829-4511-8a63-8353d64f9cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c76b1ac-995c-442b-8755-74939e170cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c76b1ac-995c-442b-8755-74939e170cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1856808838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef63cd-f3fd-4697-ba79-aca721f96f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:40Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3091c673-824a-4c3c-82d1-6bd5bd94ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3091c673-824a-4c3c-82d1-6bd5bd94ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5487f-c4f2-4c2e-99e9-e20f9389a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f5487f-c4f2-4c2e-99e9-e20f9389a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ef63cd-f3fd-4697-ba79-aca721f96f3f', 'volume_name': 'volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c270d60b-d534-43ca-ac2d-8a4b06b82657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c270d60b-d534-43ca-ac2d-8a4b06b82657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0c9da-7111-4e22-9de4-3b9273ce0dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:40 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Volume 70ef63cd-f3fd-4697-ba79-aca721f96f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f', 'volume_size': 1} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:40 devstack cinder-volume[91865]: WARNING cinder.quota [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-926134928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-926134928, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Created reservations ['6408423e-e7f4-4d71-adc7-fb0eabff012d', 'f06b9051-fb65-4b77-a5e8-1cb52939aae6', 'aee4bf2c-3be5-41a4-945e-aedf566ee90c', '61312097-aed6-48e2-93d7-decb1cabe54e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:40 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 1073741824" returned: 0 in 1.146s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Created reservations ['24b5df3f-9659-4c23-b8ec-0e4e904f9373', '2d6ef3a6-a2cc-4921-a50a-5a659a3e0a75', '0b6f2e13-dcda-4723-825d-f906d68f5c55', '4db01f09-d2f2-43f7-8007-035826bb400f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:40 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 Jun 15 07:29:40 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:40 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:40 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:41 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598" returned: 0 in 0.654s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1856808838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ef63cd-f3fd-4697-ba79-aca721f96f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:40Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Creating volume 70ef63cd-f3fd-4697-ba79-aca721f96f3f {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:41 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:41 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f 1073741824 Jun 15 07:29:41 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa7d455-e5d5-484a-949b-20029ba186d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe65916-6f30-4ff4-92a8-f81c8d191598', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c76400d-0fa7-4d31-8411-6f8195c19ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:41 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Volume volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 (1fe65916-6f30-4ff4-92a8-f81c8d191598): created successfully Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c76400d-0fa7-4d31-8411-6f8195c19ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Flow 'volume_create_manager' (f0abd085-f425-4ad0-9505-9ba9e960caf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4c075044-fa39-4af1-b2e4-3a03bbdd63e5 tempest-VolumesActionsTest-155708643 None] Created volume successfully. Jun 15 07:29:41 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:41 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-976d4b01-dd90-42d3-b58b-fc7d3590b01a tempest-GroupSnapshotsTest-602728984 None] Delete group completed successfully. Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-1fe65916-6f30-4ff4-92a8-f81c8d191598-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:42 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c704bc03-4a1a-4989-902b-453be32bd7b5 tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-1995661937: creating Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f 1073741824" returned: 0 in 1.160s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "cinder-1fe65916-6f30-4ff4-92a8-f81c8d191598-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c704bc03-4a1a-4989-902b-453be32bd7b5 tempest-GroupSnapshotsTest-602728984 None] Group tempest-GroupSnapshotsTest-Group-1995661937: created successfully Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Acquiring lock "cinder-quobyte-1fe65916-6f30-4ff4-92a8-f81c8d191598" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c704bc03-4a1a-4989-902b-453be32bd7b5 tempest-GroupSnapshotsTest-602728984 None] Create group completed successfully. Jun 15 07:29:42 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f Jun 15 07:29:42 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "cinder-quobyte-1fe65916-6f30-4ff4-92a8-f81c8d191598" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f845fd52-2d67-4c7f-92b3-070028f94a55]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:42 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 Jun 15 07:29:42 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:43 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f" returned: 0 in 0.661s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0c9da-7111-4e22-9de4-3b9273ce0dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e56f527-5af2-44a6-b841-e0dcfa749914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:43 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Volume volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f (70ef63cd-f3fd-4697-ba79-aca721f96f3f): created successfully Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e56f527-5af2-44a6-b841-e0dcfa749914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (1a552090-f829-4511-8a63-8353d64f9cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8a3d63ce-97f3-4620-ab21-b7ed77c3473e tempest-VolumesListAdminTestJSON-1705674843 None] Created volume successfully. Jun 15 07:29:43 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598" returned: 0 in 0.898s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:43 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598 Jun 15 07:29:43 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (2cd727a2-b498-4024-ad08-240fcb8b5381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a540b-7032-4a90-b433-1a0ebff1809c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a540b-7032-4a90-b433-1a0ebff1809c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36340742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9f35bfe-9ac5-420f-8bda-fe7b37fa8974,host='devstack@QuobyteHD#QuobyteHD',id=c096c415-125b-4dfe-a513-4c402c5c226e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:44Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f341e97-14bf-41ae-a38a-ed605302df7b),volume_type_id=9f341e97-14bf-41ae-a38a-ed605302df7b)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f725326e-ece9-45e5-af27-6f7a7d5f6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f725326e-ece9-45e5-af27-6f7a7d5f6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84265194-df9a-4e4a-b1ac-d491a9c775b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84265194-df9a-4e4a-b1ac-d491a9c775b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c096c415-125b-4dfe-a513-4c402c5c226e', 'volume_name': 'volume-c096c415-125b-4dfe-a513-4c402c5c226e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7cac95-3c22-4f0b-96a5-7c68ba0ec099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7cac95-3c22-4f0b-96a5-7c68ba0ec099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607271df-de9d-42e2-938a-b36bc624279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Volume c096c415-125b-4dfe-a513-4c402c5c226e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c096c415-125b-4dfe-a513-4c402c5c226e', 'volume_size': 1} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c9f35bfe-9ac5-420f-8bda-fe7b37fa8974,created_at=2026-06-15T05:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36340742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c9f35bfe-9ac5-420f-8bda-fe7b37fa8974,host='devstack@QuobyteHD#QuobyteHD',id=c096c415-125b-4dfe-a513-4c402c5c226e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3176cf6279d94fa1973ed24d25ededba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:44Z,use_quota=True,user_id='26fab4921c28468baa67335b8e62fb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f341e97-14bf-41ae-a38a-ed605302df7b),volume_type_id=9f341e97-14bf-41ae-a38a-ed605302df7b)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Creating volume c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:44 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:44 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e 1073741824 Jun 15 07:29:44 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (1449a333-40bf-4fb1-af5a-6cf86529b83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142f2c6-1be2-4da9-86ae-d25877f21e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1fe65916-6f30-4ff4-92a8-f81c8d191598" returned: 0 in 1.166s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142f2c6-1be2-4da9-86ae-d25877f21e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046893004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:45Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00f6dd-1a2f-4e9a-a369-168929b16101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e00f6dd-1a2f-4e9a-a369-168929b16101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f6830e-c916-47c0-ae68-29e229f90836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f6830e-c916-47c0-ae68-29e229f90836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c', 'volume_name': 'volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d175e655-9408-45a3-9cc1-91acc049fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d175e655-9408-45a3-9cc1-91acc049fea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af08d72-b3ab-4739-9425-c054fa36d85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Volume fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c', 'volume_size': 1} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "cinder-quobyte-1fe65916-6f30-4ff4-92a8-f81c8d191598" released by "delete_volume" :: held 2.173s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Created reservations ['7e2c1774-2da9-445d-aa65-1ef52149db20', 'f28e7573-e82b-490b-8a13-a3c7bd2dc07a', '6e66b61d-e781-4e03-a21b-87fff4532542', '3cb7db3d-0144-403d-aa11-7522fc53005f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:44 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:44 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e 1073741824" returned: 0 in 1.009s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:45 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e Jun 15 07:29:45 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:45 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.664s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:45 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Deleted volume successfully. Jun 15 07:29:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9394302d-1632-4240-8ed2-77dc2c8a30f9 tempest-VolumesActionsTest-155708643 None] Lock "cinder-1fe65916-6f30-4ff4-92a8-f81c8d191598-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:46 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1046893004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d1b3e1c7a46a1ac05c6e21261ab56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:45Z,use_quota=True,user_id='07e36e5d94234c6ab53f12b4156dff69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Creating volume fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:46 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:46 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c 1073741824 Jun 15 07:29:46 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607271df-de9d-42e2-938a-b36bc624279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c096c415-125b-4dfe-a513-4c402c5c226e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb4c4d2-cb80-42a1-963e-4538290ba1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Volume volume-c096c415-125b-4dfe-a513-4c402c5c226e (c096c415-125b-4dfe-a513-4c402c5c226e): created successfully Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb4c4d2-cb80-42a1-963e-4538290ba1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Flow 'volume_create_manager' (2cd727a2-b498-4024-ad08-240fcb8b5381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2a1034eb-4754-4ecc-8095-fbd1118dbaa6 tempest-GroupSnapshotsTest-602728984 None] Created volume successfully. Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:46 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:46 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] GroupSnapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: creating. Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Group snapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: creating. {{(pid=91865) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:29:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:47 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c 1073741824" returned: 0 in 1.296s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:47 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c Jun 15 07:29:47 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:47 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.057s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:29:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:29:48 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" returned: 0 in 0.731s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.280s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af08d72-b3ab-4739-9425-c054fa36d85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81509fa1-d4ac-46b2-808b-a9415d560769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Creating offline snapshot 7e7c36c4-9e07-431a-952b-401df8826595 of volume c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:29:48 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Volume volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c (fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c): created successfully Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81509fa1-d4ac-46b2-808b-a9415d560769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Flow 'volume_create_manager' (1449a333-40bf-4fb1-af5a-6cf86529b83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc17ab9-0b93-4f95-9a23-61ad27203416]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-30cb02c4-d9ee-4b5a-9f70-9a42f9f502e6 tempest-VolumesListAdminTestJSON-1705674843 None] Created volume successfully. Jun 15 07:29:48 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e Jun 15 07:29:48 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:49 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e" returned: 0 in 0.942s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:49 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 1G Jun 15 07:29:49 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Flow 'volume_create_manager' (c5c743be-f0f8-4640-ae1a-67f8c2998bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f216ac46-6807-4960-b76c-5dc39c0e7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f216ac46-6807-4960-b76c-5dc39c0e7305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee669ccb-2615-4cf8-b605-7e517a7301d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579c77eb39774449bb4d4a7eba48075b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:50Z,use_quota=True,user_id='a1fc1ae5b4164efea673e5df70d0312a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd0dd0a-40f8-4544-a400-941b27a1a665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd0dd0a-40f8-4544-a400-941b27a1a665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4f51b3-c078-40ce-86c1-4135bcf05383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4f51b3-c078-40ce-86c1-4135bcf05383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee669ccb-2615-4cf8-b605-7e517a7301d7', 'volume_name': 'volume-ee669ccb-2615-4cf8-b605-7e517a7301d7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab5aae5-cc73-4863-83d3-058f344cac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab5aae5-cc73-4863-83d3-058f344cac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27437736-4e88-4b4c-8aab-1b278da553d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Volume ee669ccb-2615-4cf8-b605-7e517a7301d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee669ccb-2615-4cf8-b605-7e517a7301d7', 'volume_size': 1} Jun 15 07:29:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:50 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 1G" returned: 0 in 1.046s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c096c415-125b-4dfe-a513-4c402c5c226e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:50 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c096c415-125b-4dfe-a513-4c402c5c226e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 Jun 15 07:29:50 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:51 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c096c415-125b-4dfe-a513-4c402c5c226e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595" returned: 0 in 0.852s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:51 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:51 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 Jun 15 07:29:51 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:51 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595" returned: 0 in 0.701s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:51 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info Jun 15 07:29:51 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (ed69bb78-781e-4c50-9daa-9a2b3fc24496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367f723d-ce10-4cd6-ba4d-3fd1aecc6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367f723d-ce10-4cd6-ba4d-3fd1aecc6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-785288416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01fa6dc-eaa0-4125-b51e-d55a6f62337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:52Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78ace943-720b-4f30-857d-f779db106dae),volume_type_id=78ace943-720b-4f30-857d-f779db106dae)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c47d229-168a-4d45-a9bd-d22f724fe64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c47d229-168a-4d45-a9bd-d22f724fe64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62d54ae-8c04-47d8-9eb9-f9a904837722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62d54ae-8c04-47d8-9eb9-f9a904837722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01fa6dc-eaa0-4125-b51e-d55a6f62337b', 'volume_name': 'volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0ed94e-7aee-4c89-94c9-4ac1cf4e98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0ed94e-7aee-4c89-94c9-4ac1cf4e98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e6613a-f7f0-450e-ab41-d8ed11cd36b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Volume f01fa6dc-eaa0-4125-b51e-d55a6f62337b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b', 'volume_size': 1} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:52 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info" returned: 0 in 0.767s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:52 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:52 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info Jun 15 07:29:52 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (d07f03fb-2da6-4106-8d9a-c18d18b45807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8138ec5-bf14-4919-afa9-25bbff66b0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8138ec5-bf14-4919-afa9-25bbff66b0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1683308545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629ff970-5132-4a5b-8a4d-ee19f9b66a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:53Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31fc0376-ae50-4c49-be6c-8b4aeb6844d3),volume_type_id=31fc0376-ae50-4c49-be6c-8b4aeb6844d3)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f9eca-1d3e-460b-8515-f48a7148746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f9eca-1d3e-460b-8515-f48a7148746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a704bfe0-c1cf-47a1-8d89-4e9eaf4649f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a704bfe0-c1cf-47a1-8d89-4e9eaf4649f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629ff970-5132-4a5b-8a4d-ee19f9b66a46', 'volume_name': 'volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452eb14c-1ae7-41e1-ab9b-f95ce6aa0131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452eb14c-1ae7-41e1-ab9b-f95ce6aa0131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2df3b6-efb9-4191-b1ba-3e67adfa3a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:52 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume 629ff970-5132-4a5b-8a4d-ee19f9b66a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46', 'volume_size': 1} Jun 15 07:29:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:53 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.info" returned: 0 in 0.814s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.276s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.745s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee669ccb-2615-4cf8-b605-7e517a7301d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579c77eb39774449bb4d4a7eba48075b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:50Z,use_quota=True,user_id='a1fc1ae5b4164efea673e5df70d0312a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Creating volume ee669ccb-2615-4cf8-b605-7e517a7301d7 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:53 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:53 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 1073741824 Jun 15 07:29:53 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (2b1d99c6-c204-43f0-8ec8-c92c566d6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56de8719-4838-4164-a9a8-4ddb0cc760f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56de8719-4838-4164-a9a8-4ddb0cc760f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-609080251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa0124-1656-4a9d-ba61-151cf262ce17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:54Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b30b7362-d879-4e38-b3b2-f96d815ca3cd),volume_type_id=b30b7362-d879-4e38-b3b2-f96d815ca3cd)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef2c9e-1084-418a-b5c7-2dbaeaf27110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eef2c9e-1084-418a-b5c7-2dbaeaf27110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaafc59-0579-45ca-8ea7-e83ac636a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:53 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:29:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5bb3072c-aa9a-4e31-a619-cdfb0e37c23b tempest-GroupSnapshotsTest-602728984 None] group_snapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: created successfully Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faaafc59-0579-45ca-8ea7-e83ac636a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35fa0124-1656-4a9d-ba61-151cf262ce17', 'volume_name': 'volume-35fa0124-1656-4a9d-ba61-151cf262ce17', 'volume_size': 1, 'image_id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346663161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36d8e66e55df439db95f0d6060b26784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eef31268-0814-4607-b836-1f9c08e2853c/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b91e4-9a26-466f-b810-c1cd2444d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72b91e4-9a26-466f-b810-c1cd2444d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa5cf5c-1c0e-4a29-9329-0062d846a82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:54 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume 35fa0124-1656-4a9d-ba61-151cf262ce17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35fa0124-1656-4a9d-ba61-151cf262ce17', 'volume_size': 1, 'image_id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346663161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36d8e66e55df439db95f0d6060b26784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eef31268-0814-4607-b836-1f9c08e2853c/file', 'properties': {}}, 'image_service': } Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Trying to clone 35fa0124-1656-4a9d-ba61-151cf262ce17 from image eef31268-0814-4607-b836-1f9c08e2853c at location (None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:29:54 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:54 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] group_snapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: deleting Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 1073741824" returned: 0 in 1.111s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] group_snapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: deleting {{(pid=91865) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:54 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-7e7c36c4-9e07-431a-952b-401df8826595" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:54 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7e7c36c4-9e07-431a-952b-401df8826595" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Deleting offline snapshot 7e7c36c4-9e07-431a-952b-401df8826595 of volume c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] snapshot_file for this snap is: volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c854da84-1af0-4d17-aed0-d396958bbe13]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:54 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 Jun 15 07:29:54 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:55 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7" returned: 0 in 0.814s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.149s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-785288416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01fa6dc-eaa0-4125-b51e-d55a6f62337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:52Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78ace943-720b-4f30-857d-f779db106dae),volume_type_id=78ace943-720b-4f30-857d-f779db106dae)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Creating volume f01fa6dc-eaa0-4125-b51e-d55a6f62337b {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:55 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:55 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b 1073741824 Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27437736-4e88-4b4c-8aab-1b278da553d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee669ccb-2615-4cf8-b605-7e517a7301d7', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:55 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f89b800-fb71-49b5-9335-7d309bd362fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Volume volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 (ee669ccb-2615-4cf8-b605-7e517a7301d7): created successfully Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f89b800-fb71-49b5-9335-7d309bd362fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Flow 'volume_create_manager' (c5c743be-f0f8-4640-ae1a-67f8c2998bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:55 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-54d0b9fa-6a9a-42cb-85ef-d3eac4cf060c tempest-VolumesListAdminTestJSON-399710990 None] Created volume successfully. Jun 15 07:29:55 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595" returned: 0 in 1.022s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c096c415-125b-4dfe-a513-4c402c5c226e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d275f7-b20d-45eb-8590-37b776184c59]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:56 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e Jun 15 07:29:56 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Acquiring lock "cinder-ee669ccb-2615-4cf8-b605-7e517a7301d7-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "cinder-ee669ccb-2615-4cf8-b605-7e517a7301d7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Acquiring lock "cinder-quobyte-ee669ccb-2615-4cf8-b605-7e517a7301d7" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "cinder-quobyte-ee669ccb-2615-4cf8-b605-7e517a7301d7" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d40ca-1f93-44d5-97f9-b54f0e68e728]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:56 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 Jun 15 07:29:56 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=151,cinder:UPDATE=182,cinder:INSERT=39,cinder:DELETE=10 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:29:56 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=182,cinder:SELECT=142,cinder:INSERT=43,cinder:DELETE=13 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b 1073741824" returned: 0 in 1.206s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-quobyte-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" acquired by "delete_volume" :: waited 0.043s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:29:56 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b Jun 15 07:29:56 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383954d-e598-42c2-8b41-03cf0f6329a8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:29:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e" returned: 0 in 1.177s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 Jun 15 07:29:57 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:57 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c Jun 15 07:29:57 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:57 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7" returned: 0 in 1.316s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:57 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7 Jun 15 07:29:57 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:57 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" returned: 0 in 1.153s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.149s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1683308545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=629ff970-5132-4a5b-8a4d-ee19f9b66a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:53Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31fc0376-ae50-4c49-be6c-8b4aeb6844d3),volume_type_id=31fc0376-ae50-4c49-be6c-8b4aeb6844d3)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Creating volume 629ff970-5132-4a5b-8a4d-ee19f9b66a46 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:29:57 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:29:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:58 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 1073741824 Jun 15 07:29:58 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:58 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e6613a-f7f0-450e-ab41-d8ed11cd36b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96644423-8619-4b9b-9407-81372ed3f088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" returned: 0 in 1.146s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:58 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Volume volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b (f01fa6dc-eaa0-4125-b51e-d55a6f62337b): created successfully Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96644423-8619-4b9b-9407-81372ed3f088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (ed69bb78-781e-4c50-9daa-9a2b3fc24496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:29:58 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c Jun 15 07:29:58 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b379213a-2dac-4ac8-a4c2-c7f0c964708e tempest-TestInstancesWithCinderVolumes-382288086 None] Created volume successfully. Jun 15 07:29:58 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595" returned: 0 in 1.239s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:58 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595 Jun 15 07:29:58 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:58 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" returned: 0 in 0.891s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:58 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c" released by "delete_volume" :: held 2.141s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ee669ccb-2615-4cf8-b605-7e517a7301d7" returned: 0 in 1.122s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "cinder-quobyte-ee669ccb-2615-4cf8-b605-7e517a7301d7" released by "delete_volume" :: held 2.520s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Created reservations ['48df83aa-4c2f-410c-a1a4-6cf65141641f', '5b94bb3c-9e2c-42d3-994f-be33ad449106', '03e82d20-74c1-4b6f-a51b-099923951f3e', 'e037ee08-f2f0-4008-bf4f-afb38393814a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:59 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Created reservations ['54ab0e02-2f38-4317-bdd5-7f65244eab3a', 'b628777a-5bb3-4ade-a02c-ba133cfa7d97', '563ee0a2-e73d-4fd4-a64f-6826e4c40ba1', '07d9261f-994f-4063-9102-1bdb90c35c65'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e.7e7c36c4-9e07-431a-952b-401df8826595" returned: 0 in 0.836s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-7e7c36c4-9e07-431a-952b-401df8826595" released by "_delete_snapshot" :: held 4.430s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" released by "delete_snapshot" :: held 4.467s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:59 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack cinder-volume[91865]: WARNING cinder.quota [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1822780828 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1822780828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:59 devstack cinder-volume[91865]: WARNING cinder.quota [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1822780828 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1822780828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:29:59 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:29:59 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['b4d46780-b648-4c9a-8f82-898f22ae7a00', 'a10d1088-fca6-4fc1-a877-15fc5aab4173', '170cb0db-86e5-48d4-8770-847ac93b74a4', 'ad42d33c-084d-47c3-910a-15ec23956d76'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:29:59 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 1073741824" returned: 0 in 1.471s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:29:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4dae7135-28eb-48e9-8faf-090ee79a8f57 tempest-GroupSnapshotsTest-602728984 None] group_snapshot b0c07f99-ea31-47d7-9bbb-b23c928e0335: deleted successfully Jun 15 07:29:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:29:59 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 Jun 15 07:29:59 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:00 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.953s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:00 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Deleted volume successfully. Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa9aec6a-33f8-49e4-84ce-7bfa809ebd3a tempest-VolumesListAdminTestJSON-399710990 None] Lock "cinder-ee669ccb-2615-4cf8-b605-7e517a7301d7-delete_volume" released by "delete_volume" :: held 3.940s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-70ef63cd-f3fd-4697-ba79-aca721f96f3f-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:00 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.128s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-70ef63cd-f3fd-4697-ba79-aca721f96f3f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:00 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Deleted volume successfully. Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a00f891f-2a8c-4063-8537-891d71f65767 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-fd74ceb4-ae05-4aa7-8e6b-1e1f8106279c-delete_volume" released by "delete_volume" :: held 3.799s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-quobyte-70ef63cd-f3fd-4697-ba79-aca721f96f3f" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:00 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46" returned: 0 in 1.018s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.562s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-70ef63cd-f3fd-4697-ba79-aca721f96f3f" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2df3b6-efb9-4191-b1ba-3e67adfa3a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc00eb8a-f241-4e9c-b85d-00865e28a948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3d19e2-3e82-4823-bd46-f67c5d7a8c80]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:00 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 (629ff970-5132-4a5b-8a4d-ee19f9b66a46): created successfully Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc00eb8a-f241-4e9c-b85d-00865e28a948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (d07f03fb-2da6-4106-8d9a-c18d18b45807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:00 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0a8aff70-5c4f-4f49-b0f7-6aee1703e776 tempest-TestInstancesWithCinderVolumes-382288086 None] Created volume successfully. Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:00 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f Jun 15 07:30:00 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[17771061-7d36-4fbe-a464-801d3e44bed7]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:01 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e Jun 15 07:30:01 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD, size 20.69 MB, duration 7.14 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:30:01 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Image download 20.69 MB at 2.90 MB/s Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba72b64-f2ed-4040-8c59-6e2314011b00]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:01 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD Jun 15 07:30:01 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:01 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f" returned: 0 in 1.151s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:01 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f Jun 15 07:30:01 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:01 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e" returned: 0 in 1.019s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:01 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e Jun 15 07:30:01 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:02 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Temporary image eef31268-0814-4607-b836-1f9c08e2853c is fetched for user 68617b176b4e4d408a0333742f74eb1f. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d912aa-a6d1-4726-b317-0cb1fe26f228]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:02 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:02 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD Jun 15 07:30:02 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-70ef63cd-f3fd-4697-ba79-aca721f96f3f" returned: 0 in 0.850s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:02 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c096c415-125b-4dfe-a513-4c402c5c226e" returned: 0 in 0.763s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-70ef63cd-f3fd-4697-ba79-aca721f96f3f" released by "delete_volume" :: held 2.105s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Lock "cinder-quobyte-c096c415-125b-4dfe-a513-4c402c5c226e" released by "delete_volume" :: held 1.914s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Created reservations ['4a3ab39a-3fea-408e-ba5f-389925e7171e', 'b74c3a8c-7085-4176-91e9-7f18c395bcb1', '7c7c3e3d-7a37-4855-b5d2-128262272ac1', '8b6ba5fd-548a-4dbb-95f2-3b5857fb0183'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['8756a7c6-acc2-491b-bd50-a067337c32a4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:02 devstack cinder-volume[91865]: WARNING cinder.quota [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1822780828 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1822780828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:02 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Created reservations ['ba24724c-02dd-418d-8aa8-bf1f9edc414b', 'edcd97a2-d113-4f00-bf96-de25d1e5daed', '62aea3ab-c45f-4967-aab7-ae0491780a96', '28b74604-b12b-47fc-a0d6-cbb197a687d1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:02 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:02 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:03 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:03 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:03 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-609080251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fa0124-1656-4a9d-ba61-151cf262ce17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36d8e66e55df439db95f0d6060b26784',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:29:54Z,use_quota=True,user_id='68617b176b4e4d408a0333742f74eb1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b30b7362-d879-4e38-b3b2-f96d815ca3cd),volume_type_id=b30b7362-d879-4e38-b3b2-f96d815ca3cd)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Creating volume 35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:03 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:03 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1073741824 Jun 15 07:30:03 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:03 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Deleted volume successfully. Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a57e114a-20f6-4495-b3dc-d7645e83d93a tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-70ef63cd-f3fd-4697-ba79-aca721f96f3f-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:03 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f0f569ea-fd31-4e59-bd23-851f600a2ef7 tempest-GroupSnapshotsTest-602728984 None] Delete group completed successfully. Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-8a7b88a5-0779-40c0-9974-9d3c62ac04b2-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-8a7b88a5-0779-40c0-9974-9d3c62ac04b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Flow 'volume_create_manager' (06092cf0-2330-4451-8400-671bf1dca792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b044e6-762b-411d-91b4-b409dcbae5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b044e6-762b-411d-91b4-b409dcbae5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-434005066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51771f27-17b0-4118-a638-fe026ce6922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dc39a522b408a8d8505f7bf791f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:04Z,use_quota=True,user_id='cc5d65d4048d41e581e7469a3f75ba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34209064-b65a-4715-8f44-268f7d7bc636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34209064-b65a-4715-8f44-268f7d7bc636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a28bf9-c8c6-4e0d-a6a7-5ee3e3dd4ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a28bf9-c8c6-4e0d-a6a7-5ee3e3dd4ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51771f27-17b0-4118-a638-fe026ce6922a', 'volume_name': 'volume-51771f27-17b0-4118-a638-fe026ce6922a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b15417-d0a9-422f-986b-6b279c10ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b15417-d0a9-422f-986b-6b279c10ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2364bda2-f8cb-4b89-af94-f582ac801137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Volume 51771f27-17b0-4118-a638-fe026ce6922a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51771f27-17b0-4118-a638-fe026ce6922a', 'volume_size': 1} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "cinder-quobyte-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f3f65-16f4-4130-bcee-b146829898a0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:04 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 Jun 15 07:30:04 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:04 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1073741824" returned: 0 in 0.985s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:04 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:04 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:04 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" returned: 0 in 0.816s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:04 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2 Jun 15 07:30:04 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:04 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 0.674s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-434005066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51771f27-17b0-4118-a638-fe026ce6922a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='591dc39a522b408a8d8505f7bf791f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:04Z,use_quota=True,user_id='cc5d65d4048d41e581e7469a3f75ba39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Creating volume 51771f27-17b0-4118-a638-fe026ce6922a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:05 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:05 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a 1073741824 Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Attempting download of eef31268-0814-4607-b836-1f9c08e2853c ((None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}])) to volume 35fa0124-1656-4a9d-ba61-151cf262ce17. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:30:05 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f940a901-9f53-4982-a39c-3b88af7cb715]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:05 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9 Jun 15 07:30:05 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:05 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" returned: 0 in 0.791s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-quobyte-8a7b88a5-0779-40c0-9974-9d3c62ac04b2" released by "delete_volume" :: held 1.651s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Created reservations ['d6f769cd-50ac-4e95-9b35-a63672b1d282', '022fa833-d1e7-4f72-8808-c31afe84ef01', '2a68f116-aa0d-4b17-acaf-829306636cb8', '811777d2-5b73-49db-92e9-31f4097314a1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:05 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:05 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:06 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a 1073741824" returned: 0 in 1.061s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:06 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9" returned: 0 in 0.985s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:06 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a Jun 15 07:30:06 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:06 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9 Jun 15 07:30:06 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:06 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.044s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Deleted volume successfully. Jun 15 07:30:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3fb0cfc3-2fa9-4530-9f1e-ce06add85044 tempest-VolumesListAdminTestJSON-1705674843 None] Lock "cinder-8a7b88a5-0779-40c0-9974-9d3c62ac04b2-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:07 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9" returned: 1 in 0.925s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eef31268-0814-4607-b836-1f9c08e2853c_70nxdsb9' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5f7321-a622-43f4-adff-4e7d530291fd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:07 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a" returned: 0 in 0.931s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2364bda2-f8cb-4b89-af94-f582ac801137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51771f27-17b0-4118-a638-fe026ce6922a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eeb7f2-2c62-4794-985e-afe91df90ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Volume volume-51771f27-17b0-4118-a638-fe026ce6922a (51771f27-17b0-4118-a638-fe026ce6922a): created successfully Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0eeb7f2-2c62-4794-985e-afe91df90ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Flow 'volume_create_manager' (06092cf0-2330-4451-8400-671bf1dca792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f088c69a-2c21-46d1-b362-4b270e183e8a tempest-VolumesMetadataTest-1120600302 None] Created volume successfully. Jun 15 07:30:07 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD Jun 15 07:30:07 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:07 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] eef31268-0814-4607-b836-1f9c08e2853c was qcow2, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:30:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:07 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:07 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Acquiring lock "cinder-51771f27-17b0-4118-a638-fe026ce6922a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "cinder-51771f27-17b0-4118-a638-fe026ce6922a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Acquiring lock "cinder-quobyte-51771f27-17b0-4118-a638-fe026ce6922a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "cinder-quobyte-51771f27-17b0-4118-a638-fe026ce6922a" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb04a5-d50a-4f5d-ad61-4e57a6d64043]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:09 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a Jun 15 07:30:09 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:10 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a" returned: 0 in 0.883s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:10 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a Jun 15 07:30:10 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-14234fbc-14a3-423f-93a0-8c0b3467a383 tempest-GroupSnapshotsV319Test-2070122702 None] Group tempest-GroupSnapshotsV319Test-Group-1314057884: creating Jun 15 07:30:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-14234fbc-14a3-423f-93a0-8c0b3467a383 tempest-GroupSnapshotsV319Test-2070122702 None] Group tempest-GroupSnapshotsV319Test-Group-1314057884: created successfully Jun 15 07:30:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-14234fbc-14a3-423f-93a0-8c0b3467a383 tempest-GroupSnapshotsV319Test-2070122702 None] Create group completed successfully. Jun 15 07:30:10 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 2.657s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:10 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eef31268-0814-4607-b836-1f9c08e2853c_pxcpzifsdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:30:10 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Converted 112.00 MB image at 42.14 MB/s Jun 15 07:30:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:10 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1G Jun 15 07:30:10 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:11 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-51771f27-17b0-4118-a638-fe026ce6922a" returned: 0 in 0.653s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "cinder-quobyte-51771f27-17b0-4118-a638-fe026ce6922a" released by "delete_volume" :: held 1.589s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Created reservations ['be8bee06-f0bf-4b4f-9322-14776b4d0bc9', '72d27885-7861-456e-be0d-192555767cd4', '54026907-1752-47dc-952e-f1374bb68dbb', '7414b7c2-b135-4634-95c9-9b4f4cfb1b2f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:11 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 1G" returned: 0 in 0.649s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:11 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:11 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e161a-9899-4246-a036-765559a4bbd4]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:11 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:11 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:11 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.706s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Deleted volume successfully. Jun 15 07:30:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1c05fd07-d851-4555-ba86-41bd1e61de81 tempest-VolumesMetadataTest-1120600302 None] Lock "cinder-51771f27-17b0-4118-a638-fe026ce6922a-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:12 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 0.947s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Flow 'volume_create_manager' (aa0d27e7-cf5c-49df-a128-01d366c840ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:12 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:12 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea423d8-2c5f-43b9-820d-b09289f3d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea423d8-2c5f-43b9-820d-b09289f3d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245367417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25e44174-7a95-4463-833e-81a65e9d950d,host='devstack@QuobyteHD#QuobyteHD',id=de11c614-7f25-4faa-93f1-60659becd306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777aeda7d4484fbaa7f727336e5976c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:12Z,use_quota=True,user_id='ecb8a453f92a40228f38dc6ed002bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34be5098-c3e2-4985-a277-16faa2929a42),volume_type_id=34be5098-c3e2-4985-a277-16faa2929a42)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e885b108-6789-4f2b-9c7c-908541197082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e885b108-6789-4f2b-9c7c-908541197082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5fd342-b90d-45b4-ba48-523804825a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5fd342-b90d-45b4-ba48-523804825a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de11c614-7f25-4faa-93f1-60659becd306', 'volume_name': 'volume-de11c614-7f25-4faa-93f1-60659becd306', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5028476-293b-4063-b5cb-1d4344b5f5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5028476-293b-4063-b5cb-1d4344b5f5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce5c995-10f7-4418-9510-3f0489a81a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Volume de11c614-7f25-4faa-93f1-60659becd306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de11c614-7f25-4faa-93f1-60659becd306', 'volume_size': 1} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25e44174-7a95-4463-833e-81a65e9d950d,created_at=2026-06-15T05:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245367417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25e44174-7a95-4463-833e-81a65e9d950d,host='devstack@QuobyteHD#QuobyteHD',id=de11c614-7f25-4faa-93f1-60659becd306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777aeda7d4484fbaa7f727336e5976c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:12Z,use_quota=True,user_id='ecb8a453f92a40228f38dc6ed002bd11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34be5098-c3e2-4985-a277-16faa2929a42),volume_type_id=34be5098-c3e2-4985-a277-16faa2929a42)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Creating volume de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:12 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 1073741824 Jun 15 07:30:12 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:13 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 1 in 0.966s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Downloaded image eef31268-0814-4607-b836-1f9c08e2853c ((None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}])) to volume 35fa0124-1656-4a9d-ba61-151cf262ce17 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Temporary image eef31268-0814-4607-b836-1f9c08e2853c for user 68617b176b4e4d408a0333742f74eb1f is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Marking volume 35fa0124-1656-4a9d-ba61-151cf262ce17 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Copying metadata from image eef31268-0814-4607-b836-1f9c08e2853c to 35fa0124-1656-4a9d-ba61-151cf262ce17. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Creating volume glance metadata for volume 35fa0124-1656-4a9d-ba61-151cf262ce17 backed by image eef31268-0814-4607-b836-1f9c08e2853c with: {'image_id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'image_name': 'tempest-scenario-img--1346663161', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa5cf5c-1c0e-4a29-9329-0062d846a82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fa0124-1656-4a9d-ba61-151cf262ce17', 'volume_size': 1, 'image_id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eef31268-0814-4607-b836-1f9c08e2853c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346663161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36d8e66e55df439db95f0d6060b26784', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'eef31268-0814-4607-b836-1f9c08e2853c', 'created_at': datetime.datetime(2026, 6, 15, 5, 29, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 29, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eef31268-0814-4607-b836-1f9c08e2853c/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf3799-8de8-4f50-baac-803b28b4e47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Volume volume-35fa0124-1656-4a9d-ba61-151cf262ce17 (35fa0124-1656-4a9d-ba61-151cf262ce17): created successfully Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcf3799-8de8-4f50-baac-803b28b4e47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Flow 'volume_create_manager' (2b1d99c6-c204-43f0-8ec8-c92c566d6f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-202d342e-714e-4b3e-923f-5d4981f40713 tempest-TestInstancesWithCinderVolumes-382288086 None] Created volume successfully. Jun 15 07:30:13 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 1073741824" returned: 0 in 1.168s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:13 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 Jun 15 07:30:13 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:14 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce5c995-10f7-4418-9510-3f0489a81a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de11c614-7f25-4faa-93f1-60659becd306', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b21c5fe-fd23-49c5-a528-46f3a2869f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:14 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Volume volume-de11c614-7f25-4faa-93f1-60659becd306 (de11c614-7f25-4faa-93f1-60659becd306): created successfully Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b21c5fe-fd23-49c5-a528-46f3a2869f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Flow 'volume_create_manager' (aa0d27e7-cf5c-49df-a128-01d366c840ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9c7f259d-d151-4708-a457-3189b09c86dc tempest-GroupSnapshotsV319Test-2070122702 None] Created volume successfully. Jun 15 07:30:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] GroupSnapshot 102444ca-b71c-44dc-a927-22f33bcff51f: creating. Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Group snapshot 102444ca-b71c-44dc-a927-22f33bcff51f: creating. {{(pid=91865) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Creating offline snapshot 4dba7658-6605-474f-8c43-4fd59a869693 of volume de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4112d5-1d83-4e4c-9aaf-eb02966f6e3b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Flow 'volume_create_manager' (039ccd39-4972-429a-9ec9-8965840bd15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:16 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 Jun 15 07:30:16 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4676cb1-eac5-43ff-b5fa-394ad30e211a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4676cb1-eac5-43ff-b5fa-394ad30e211a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-181295372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff794c24-7882-4b9a-8c64-a562e4836d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852e655e8c3f4f8593728f5ac9a415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:16Z,use_quota=True,user_id='21c8a9b5872e47c6b0ee4bb7c3155165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bfca2d-3e05-41a5-b39a-c73b9e378be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bfca2d-3e05-41a5-b39a-c73b9e378be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d6a282-c48c-4818-a3a9-687143a37ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d6a282-c48c-4818-a3a9-687143a37ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff794c24-7882-4b9a-8c64-a562e4836d0c', 'volume_name': 'volume-ff794c24-7882-4b9a-8c64-a562e4836d0c', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5d6511-e869-41ab-b65b-b6535c0e6b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5d6511-e869-41ab-b65b-b6535c0e6b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c3feed-082e-48dc-8f88-4ce7139c9f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:16 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Volume ff794c24-7882-4b9a-8c64-a562e4836d0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff794c24-7882-4b9a-8c64-a562e4836d0c', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Trying to clone ff794c24-7882-4b9a-8c64-a562e4836d0c from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c at location (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:30:16 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306" returned: 0 in 0.860s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:16 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 1G Jun 15 07:30:16 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:30:17 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c92cc-b20d-4777-8971-1d494de5c339]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:17 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD Jun 15 07:30:17 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Flow 'volume_create_manager' (7e364d82-6ba3-40b8-9fab-0ed2d00c01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce36fed1-c602-4559-857b-4500d5f35010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce36fed1-c602-4559-857b-4500d5f35010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-551641256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc32b28d-9b48-4c38-8f2c-f816ed58d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847f5a1390bd421fad56257777bd6fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:17Z,use_quota=True,user_id='6f103dc11453427bbe3c252ebc231ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01488527-719c-466e-9947-193bf85d0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01488527-719c-466e-9947-193bf85d0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4974c9a-0434-4c89-828d-07a089bf56fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4974c9a-0434-4c89-828d-07a089bf56fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc32b28d-9b48-4c38-8f2c-f816ed58d9e5', 'volume_name': 'volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741176c2-c60e-444a-97b4-080a5b5fab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741176c2-c60e-444a-97b4-080a5b5fab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45cc02-6790-43c6-8769-b5f763806fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:17 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Volume dc32b28d-9b48-4c38-8f2c-f816ed58d9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5', 'volume_size': 1} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:17 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 1G" returned: 0 in 0.902s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11c614-7f25-4faa-93f1-60659becd306 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:17 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11c614-7f25-4faa-93f1-60659becd306 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 Jun 15 07:30:17 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:17 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c is fetched for user 21c8a9b5872e47c6b0ee4bb7c3155165. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66c97ae-2aad-497a-92a7-ca1a2d12162a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:18 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD Jun 15 07:30:18 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:18 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de11c614-7f25-4faa-93f1-60659becd306 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693" returned: 0 in 0.645s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:18 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:30:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:18 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 Jun 15 07:30:18 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:18 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:19 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693" returned: 0 in 0.636s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:19 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info Jun 15 07:30:19 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:19 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info" returned: 0 in 0.608s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:19 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info is being set with open permissions: ugo+rw: NotImplementedError Jun 15 07:30:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:19 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info Jun 15 07:30:19 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:20 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.info" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.361s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.887s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-551641256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc32b28d-9b48-4c38-8f2c-f816ed58d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847f5a1390bd421fad56257777bd6fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:17Z,use_quota=True,user_id='6f103dc11453427bbe3c252ebc231ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Creating volume dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:20 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:20 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 1073741824 Jun 15 07:30:20 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f58e282c-b66e-42df-b98f-9b7f1915512f tempest-GroupSnapshotsV319Test-2070122702 None] group_snapshot 102444ca-b71c-44dc-a927-22f33bcff51f: created successfully Jun 15 07:30:21 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 1073741824" returned: 0 in 0.981s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:21 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 Jun 15 07:30:21 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] group_snapshot 102444ca-b71c-44dc-a927-22f33bcff51f: deleting Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] group_snapshot 102444ca-b71c-44dc-a927-22f33bcff51f: deleting {{(pid=91865) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "cinder-quobyte-4dba7658-6605-474f-8c43-4fd59a869693" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-4dba7658-6605-474f-8c43-4fd59a869693" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Deleting offline snapshot 4dba7658-6605-474f-8c43-4fd59a869693 of volume de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] snapshot_file for this snap is: volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a105454-e6dc-4862-aeb0-9b29df70b485]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:22 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 Jun 15 07:30:22 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:22 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.497s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-181295372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff794c24-7882-4b9a-8c64-a562e4836d0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='852e655e8c3f4f8593728f5ac9a415c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:16Z,use_quota=True,user_id='21c8a9b5872e47c6b0ee4bb7c3155165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Creating volume ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:22 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:22 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1073741824 Jun 15 07:30:22 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e45cc02-6790-43c6-8769-b5f763806fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22e8f3-f34e-4c05-a455-0f3ff7be5a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:22 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Volume volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 (dc32b28d-9b48-4c38-8f2c-f816ed58d9e5): created successfully Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22e8f3-f34e-4c05-a455-0f3ff7be5a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Flow 'volume_create_manager' (7e364d82-6ba3-40b8-9fab-0ed2d00c01eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-57b269c3-2641-4a2b-b7fb-fd259345be31 tempest-VolumesTransfersTest-1733660478 None] Created volume successfully. Jun 15 07:30:22 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693" returned: 0 in 0.902s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de11c614-7f25-4faa-93f1-60659becd306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f874b9-7a5f-4dd4-bf8c-dac4f85b5474]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:22 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 Jun 15 07:30:22 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1073741824" returned: 0 in 1.008s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:23 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:23 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-dc020ee2-b0d6-49ed-bfda-8241d22c9df5 tempest-VolumesTransfersTest-205767339 None] Transfer volume completed successfully. Jun 15 07:30:23 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:23 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 Jun 15 07:30:23 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:23 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 0 in 0.678s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.875s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Attempting download of 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume ff794c24-7882-4b9a-8c64-a562e4836d0c. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3a0d32-c8ea-4c6a-829d-96d9dcb54a37]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8db79a-79ab-4cab-bc65-fcfaedda2e74]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:24 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn Jun 15 07:30:24 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693" returned: 0 in 0.839s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "cinder-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:24 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693 Jun 15 07:30:24 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "cinder-quobyte-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-quobyte-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ee103-f16d-419d-ad5d-2e884ff3f52a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 Jun 15 07:30:24 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:24 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 0.994s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:24 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn" returned: 0 in 0.958s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:30:25 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn Jun 15 07:30:25 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306.4dba7658-6605-474f-8c43-4fd59a869693" returned: 0 in 0.852s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-4dba7658-6605-474f-8c43-4fd59a869693" released by "_delete_snapshot" :: held 3.522s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" released by "delete_snapshot" :: held 3.565s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:25 devstack cinder-volume[91865]: WARNING cinder.quota [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1364584828 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1364584828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:30:25 devstack cinder-volume[91865]: WARNING cinder.quota [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1364584828 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1364584828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] Created reservations ['a97bba05-1d20-4312-808f-bd6ce2b83501', '33566ad4-3950-4d67-828b-7a636fbb13cf', '30e5f77d-3243-48d0-9fc8-feb07106b397', 'b82c016a-571f-41f1-8376-50aa58ca687e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d68801d4-54da-4524-a4f7-67c23a205270 tempest-GroupSnapshotsV319Test-2070122702 None] group_snapshot 102444ca-b71c-44dc-a927-22f33bcff51f: deleted successfully Jun 15 07:30:25 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" returned: 0 in 0.982s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5 Jun 15 07:30:25 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn" returned: 1 in 0.812s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_mo02epyn' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c2f84-956f-4a2d-8538-55223ee1c110]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:25 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD Jun 15 07:30:25 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:25 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 1 in 0.962s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.037s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-35fa0124-1656-4a9d-ba61-151cf262ce17', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9e39f17-fd12-466b-af5d-4e2d3dbd43cf', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:30:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-0cb03533-8a70-4655-a50a-2ac5057bb9ce req-1a9221ba-cb82-4285-aa57-c78238e3e705 tempest-TestInstancesWithCinderVolumes-382288086 None] attachment_update completed successfully. Jun 15 07:30:26 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" returned: 0 in 0.659s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-quobyte-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5" released by "delete_volume" :: held 1.715s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Created reservations ['2ab0e450-961f-4401-9386-94f7f8b79c47', 'fc55395b-42ff-47f8-9264-03cb1bbf1126', '029910dc-7f12-40d3-a453-85594ccbb2ec', '899f1711-1ee5-4f46-acda-bc5914bee7db'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a1d183-dc15-47ba-93da-49065744f63a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c was qcow2, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:26 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:26 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:26 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:26 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:26 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 Jun 15 07:30:26 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Flow 'volume_create_manager' (d6587171-a0d3-4e34-8ac2-cdc9b93f2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a645a1-01cf-4684-a35e-6b5855465cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a645a1-01cf-4684-a35e-6b5855465cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2053652953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847f5a1390bd421fad56257777bd6fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:27Z,use_quota=True,user_id='6f103dc11453427bbe3c252ebc231ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be95a244-c5a4-4747-88b1-f96e391e158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be95a244-c5a4-4747-88b1-f96e391e158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c2e46-a705-4abf-bbea-326d75b52f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31c2e46-a705-4abf-bbea-326d75b52f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d', 'volume_name': 'volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d44c76-ad38-450c-918e-5e00fe8651b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d44c76-ad38-450c-918e-5e00fe8651b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f64a78-1505-4ef0-b7e0-954bb06c1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:27 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Volume b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d', 'volume_size': 1} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2053652953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='847f5a1390bd421fad56257777bd6fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:27Z,use_quota=True,user_id='6f103dc11453427bbe3c252ebc231ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Creating volume b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:27 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:27 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.812s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Deleted volume successfully. Jun 15 07:30:27 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d 1073741824 Jun 15 07:30:27 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b300dfa1-7b16-4f73-ae27-b8cac3d6b12a tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-dc32b28d-9b48-4c38-8f2c-f816ed58d9e5-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:27 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306" returned: 0 in 0.922s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:27 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306 Jun 15 07:30:27 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:28 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-de11c614-7f25-4faa-93f1-60659becd306" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "cinder-quobyte-de11c614-7f25-4faa-93f1-60659becd306" released by "delete_volume" :: held 1.725s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Created reservations ['0d66f9c9-fe05-480f-b955-07589c952126'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:28 devstack cinder-volume[91865]: WARNING cinder.quota [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1364584828 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1364584828, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Created reservations ['5180593d-fb52-4764-b96c-b7c4bf551690', '48d4bbf5-ba9f-48af-bfc8-cfec660a2de4', '334f1540-67c4-41aa-a631-78b3170c5886', 'b8765e67-71db-4cdc-815d-d171ff1f3311'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:28 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d 1073741824" returned: 0 in 1.149s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:28 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:28 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:28 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d Jun 15 07:30:28 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:29 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 0 in 2.445s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_1ket60vwdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:30:29 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Converted 112.00 MB image at 45.78 MB/s Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:29 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1G Jun 15 07:30:29 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:29 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:29 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-68254c3d-b192-48eb-93db-6ef4304f93d2 tempest-GroupSnapshotsV319Test-2070122702 None] Delete group completed successfully. Jun 15 07:30:29 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" returned: 0 in 0.849s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f64a78-1505-4ef0-b7e0-954bb06c1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e720ffb1-2df3-4d93-80fa-5decd564b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:29 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Volume volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d (b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d): created successfully Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e720ffb1-2df3-4d93-80fa-5decd564b329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Flow 'volume_create_manager' (d6587171-a0d3-4e34-8ac2-cdc9b93f2b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:29 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-aacf2c79-813a-4afc-9246-0fff1c4195db tempest-VolumesTransfersTest-1733660478 None] Created volume successfully. Jun 15 07:30:29 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c 1G" returned: 0 in 0.804s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc947a-8365-4e52-bfe0-00945bb26f38]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:29 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:29 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:30 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 0 in 0.784s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:30 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:30 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "cinder-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "cinder-quobyte-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-quobyte-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[196d36cd-0a0f-4bb4-9e4d-1013b253d530]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:31 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d Jun 15 07:30:31 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:31 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 1 in 0.967s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Downloaded image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume ff794c24-7882-4b9a-8c64-a562e4836d0c successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c for user 21c8a9b5872e47c6b0ee4bb7c3155165 is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Marking volume ff794c24-7882-4b9a-8c64-a562e4836d0c as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Copying metadata from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c to ff794c24-7882-4b9a-8c64-a562e4836d0c. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Creating volume glance metadata for volume ff794c24-7882-4b9a-8c64-a562e4836d0c backed by image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c3feed-082e-48dc-8f88-4ce7139c9f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff794c24-7882-4b9a-8c64-a562e4836d0c', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c127780e-53a8-4238-b76f-9bc5ac976827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:31 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Volume volume-ff794c24-7882-4b9a-8c64-a562e4836d0c (ff794c24-7882-4b9a-8c64-a562e4836d0c): created successfully Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c127780e-53a8-4238-b76f-9bc5ac976827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Flow 'volume_create_manager' (039ccd39-4972-429a-9ec9-8965840bd15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-994ce29a-34c2-42c4-9878-1e898390585c tempest-VolumesImageMetadata-1613118108 None] Created volume successfully. Jun 15 07:30:32 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" returned: 0 in 1.375s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:32 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d Jun 15 07:30:32 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:33 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" returned: 0 in 0.895s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-quobyte-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d" released by "delete_volume" :: held 2.348s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Created reservations ['6c041be3-627b-4326-b691-563e11016b71', 'f59d489e-76b0-4fa9-affc-f238d5552aa7', 'ce5817e6-53ac-4cb6-a624-bca253b4dd6e', 'e5d5d1fd-a388-4985-9f4c-52d1631007f4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Acquiring lock "cinder-ff794c24-7882-4b9a-8c64-a562e4836d0c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:33 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:33 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "cinder-ff794c24-7882-4b9a-8c64-a562e4836d0c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Acquiring lock "cinder-quobyte-ff794c24-7882-4b9a-8c64-a562e4836d0c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "cinder-quobyte-ff794c24-7882-4b9a-8c64-a562e4836d0c" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1102f71-7540-4da8-9294-db9331707cf2]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:33 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:33 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:35 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.522s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:35 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Deleted volume successfully. Jun 15 07:30:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-df7eee44-3eeb-4622-9296-659d82073989 tempest-VolumesTransfersTest-1056961663 None] Lock "cinder-b2ac4f6a-b05f-4fe8-bbae-16b67a5a8d0d-delete_volume" released by "delete_volume" :: held 4.243s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:35 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 0 in 1.645s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:35 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:35 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:36 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 1 in 1.528s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:30:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:37 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c Jun 15 07:30:37 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:37 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ff794c24-7882-4b9a-8c64-a562e4836d0c" returned: 0 in 0.739s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "cinder-quobyte-ff794c24-7882-4b9a-8c64-a562e4836d0c" released by "delete_volume" :: held 4.027s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Created reservations ['e064d986-0217-4f66-b672-7920e04ca8b1', '56b90ef4-8593-4726-b0a5-19e6b40cb416', 'fd2c7aac-241c-4f08-9756-ed0bacc3aad2', '8511ed17-df0e-4a1c-8a0d-7b63fdc537e0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:38 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:38 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:38 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.985s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:39 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Deleted volume successfully. Jun 15 07:30:39 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-1a0d8246-6495-4729-a3cc-d04418bb64a2 tempest-VolumesImageMetadata-1613118108 None] Lock "cinder-ff794c24-7882-4b9a-8c64-a562e4836d0c-delete_volume" released by "delete_volume" :: held 5.451s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Flow 'volume_create_manager' (03630008-0c9b-4289-bace-06b8ed1e3b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5058ec2-e43f-44de-aad0-d1461a755686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5058ec2-e43f-44de-aad0-d1461a755686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1222423225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8207-0701-4a50-b1a1-83f49d510397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318919440d2c458b8d79d4ad0d072e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:46Z,use_quota=True,user_id='cb776c0ff61d4079a7a5ec17c045f21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56893b9c-0313-473a-9719-83d240e7ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56893b9c-0313-473a-9719-83d240e7ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01019199-80fa-4da6-b31f-955a36618619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01019199-80fa-4da6-b31f-955a36618619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cc8207-0701-4a50-b1a1-83f49d510397', 'volume_name': 'volume-b7cc8207-0701-4a50-b1a1-83f49d510397', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df08d81c-b479-45a9-8781-f40fe1d511b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df08d81c-b479-45a9-8781-f40fe1d511b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6196c21a-bd1d-4536-a3b1-dcc70f6bdfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Volume b7cc8207-0701-4a50-b1a1-83f49d510397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cc8207-0701-4a50-b1a1-83f49d510397', 'volume_size': 1} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1222423225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8207-0701-4a50-b1a1-83f49d510397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='318919440d2c458b8d79d4ad0d072e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:46Z,use_quota=True,user_id='cb776c0ff61d4079a7a5ec17c045f21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Creating volume b7cc8207-0701-4a50-b1a1-83f49d510397 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:46 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:46 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 1073741824 Jun 15 07:30:46 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Flow 'volume_create_manager' (d74ed908-df8b-44bd-b5cb-24da5e15f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42f0a4f-1407-46d8-ad06-07a8ba7b3139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42f0a4f-1407-46d8-ad06-07a8ba7b3139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358564229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717bf11b-4f59-4d60-a99e-1339f26b4cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd3ab5f9933422a9ed6f5c5573ba6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:46Z,use_quota=True,user_id='0a9945d4742d40b1aa65ae932bf249bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5615e237-ce66-4e5a-911a-72e95d89f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5615e237-ce66-4e5a-911a-72e95d89f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40113d79-b437-4b69-baff-94252654febc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40113d79-b437-4b69-baff-94252654febc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717bf11b-4f59-4d60-a99e-1339f26b4cae', 'volume_name': 'volume-717bf11b-4f59-4d60-a99e-1339f26b4cae', 'volume_size': 2}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd723b3-c8e4-4c7d-a4e5-687c03205287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd723b3-c8e4-4c7d-a4e5-687c03205287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f870eb5c-7d16-4854-a085-6fa3baae46b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Volume 717bf11b-4f59-4d60-a99e-1339f26b4cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717bf11b-4f59-4d60-a99e-1339f26b4cae', 'volume_size': 2} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:46 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:46 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:47 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 1073741824" returned: 0 in 1.164s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:47 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 Jun 15 07:30:47 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:47 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.040s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:30:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:30:48 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-358564229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717bf11b-4f59-4d60-a99e-1339f26b4cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd3ab5f9933422a9ed6f5c5573ba6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:46Z,use_quota=True,user_id='0a9945d4742d40b1aa65ae932bf249bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Creating volume 717bf11b-4f59-4d60-a99e-1339f26b4cae {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:48 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae 2147483648 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6196c21a-bd1d-4536-a3b1-dcc70f6bdfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cc8207-0701-4a50-b1a1-83f49d510397', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62c26f-3222-4705-a1e0-2e0704968d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:48 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae 2147483648 Jun 15 07:30:48 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:48 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Volume volume-b7cc8207-0701-4a50-b1a1-83f49d510397 (b7cc8207-0701-4a50-b1a1-83f49d510397): created successfully Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e62c26f-3222-4705-a1e0-2e0704968d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:48 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Flow 'volume_create_manager' (03630008-0c9b-4289-bace-06b8ed1e3b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-7de37e5e-5758-4433-8dc1-2d29f3352da0 tempest-AbsoluteLimitsTests-1099656512 None] Created volume successfully. Jun 15 07:30:49 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae 2147483648" returned: 0 in 1.136s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:49 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae Jun 15 07:30:49 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Acquiring lock "cinder-b7cc8207-0701-4a50-b1a1-83f49d510397-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "cinder-b7cc8207-0701-4a50-b1a1-83f49d510397-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Acquiring lock "cinder-quobyte-b7cc8207-0701-4a50-b1a1-83f49d510397" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "cinder-quobyte-b7cc8207-0701-4a50-b1a1-83f49d510397" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfb24c-9f79-4f63-a577-3e0a24524d36]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:50 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 Jun 15 07:30:50 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:50 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae" returned: 0 in 0.902s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f870eb5c-7d16-4854-a085-6fa3baae46b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717bf11b-4f59-4d60-a99e-1339f26b4cae', 'volume_size': 2}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635e17f-87bc-4106-afe5-21834454ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:50 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Volume volume-717bf11b-4f59-4d60-a99e-1339f26b4cae (717bf11b-4f59-4d60-a99e-1339f26b4cae): created successfully Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8635e17f-87bc-4106-afe5-21834454ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Flow 'volume_create_manager' (d74ed908-df8b-44bd-b5cb-24da5e15f886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-40f9dea0-6028-4771-ab87-9a4a3b15fe97 tempest-VolumesCloneNegativeTest-127230437 None] Created volume successfully. Jun 15 07:30:50 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397" returned: 0 in 1.091s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:50 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397 Jun 15 07:30:50 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Acquiring lock "cinder-717bf11b-4f59-4d60-a99e-1339f26b4cae-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "cinder-717bf11b-4f59-4d60-a99e-1339f26b4cae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Acquiring lock "cinder-quobyte-717bf11b-4f59-4d60-a99e-1339f26b4cae" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "cinder-quobyte-717bf11b-4f59-4d60-a99e-1339f26b4cae" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc81599-1ea9-43e8-869c-532c9a71c760]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:51 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae Jun 15 07:30:51 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:51 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7cc8207-0701-4a50-b1a1-83f49d510397" returned: 0 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "cinder-quobyte-b7cc8207-0701-4a50-b1a1-83f49d510397" released by "delete_volume" :: held 1.907s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Created reservations ['17ed3c98-37c1-4f24-992e-19a65d3185b4', '73444b00-0cec-4235-8dcd-9b83b3cd56a6', 'b213c14b-9a92-4e93-b83c-0cd2e2fb5a99', '3cbbdef7-276a-4b4a-96c1-1fecc643eb06'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:51 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:51 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:52 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae" returned: 0 in 0.912s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:52 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae Jun 15 07:30:52 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:52 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.751s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:52 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Deleted volume successfully. Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2245cae4-6332-450d-b730-94cb276641d8 tempest-AbsoluteLimitsTests-1099656512 None] Lock "cinder-b7cc8207-0701-4a50-b1a1-83f49d510397-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:52 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-717bf11b-4f59-4d60-a99e-1339f26b4cae" returned: 0 in 0.716s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "cinder-quobyte-717bf11b-4f59-4d60-a99e-1339f26b4cae" released by "delete_volume" :: held 1.683s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:52 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Created reservations ['f471d9be-9b45-4d3c-8ad3-9a6e224f098d', '0c938ca0-1d18-4c71-a8c7-888de749c3c8', '76f64046-369b-4998-8137-b21d9ab773c6', '9817bee8-59c8-4116-804a-c242ea3c2f60'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:53 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:53 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-78a29542-3158-4216-a9f5-0be8abc9dfca tempest-GroupsV320Test-1746891536 None] Group tempest-GroupsV320Test-Group-64540547: creating Jun 15 07:30:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-78a29542-3158-4216-a9f5-0be8abc9dfca tempest-GroupsV320Test-1746891536 None] Group tempest-GroupsV320Test-Group-64540547: created successfully Jun 15 07:30:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-78a29542-3158-4216-a9f5-0be8abc9dfca tempest-GroupsV320Test-1746891536 None] Create group completed successfully. Jun 15 07:30:53 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.752s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Deleted volume successfully. Jun 15 07:30:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-be0a4454-f434-48ad-b2e7-6559d0e63139 tempest-VolumesCloneNegativeTest-127230437 None] Lock "cinder-717bf11b-4f59-4d60-a99e-1339f26b4cae-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Created reservations ['416fd6c1-0829-4759-ac58-177e1caac30f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:55 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:30:55 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:55 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.633s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:56 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:30:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5e4dddf0-4723-4b87-8b45-0214afcadf1a tempest-GroupsV320Test-1746891536 None] Delete group completed successfully. Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=165,cinder:DELETE=10,cinder:SELECT=122,cinder:INSERT=46 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=134,cinder:UPDATE=142,cinder:INSERT=46,cinder:DELETE=10 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (6289e227-76fd-4340-a981-670831292ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df18780-4829-4239-ac7a-dbb324f22b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0df18780-4829-4239-ac7a-dbb324f22b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1753161291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a652d3a1-5d13-4f60-be01-24b5733987dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a57a152bd4a70820a85c832f7d475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:57Z,use_quota=True,user_id='197723128bad419eb46ed73aac002de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d58206-fe7c-4abe-a800-470f4d53c90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d58206-fe7c-4abe-a800-470f4d53c90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff14346-2798-4ffa-a6ec-948b2af6709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff14346-2798-4ffa-a6ec-948b2af6709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a652d3a1-5d13-4f60-be01-24b5733987dc', 'volume_name': 'volume-a652d3a1-5d13-4f60-be01-24b5733987dc', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f77ea0-fba8-41d6-88c1-127c10209bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f77ea0-fba8-41d6-88c1-127c10209bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0328334-aa06-4c32-9bb5-c11893153923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:57 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Volume a652d3a1-5d13-4f60-be01-24b5733987dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a652d3a1-5d13-4f60-be01-24b5733987dc', 'volume_size': 1} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1753161291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a652d3a1-5d13-4f60-be01-24b5733987dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a57a152bd4a70820a85c832f7d475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:30:57Z,use_quota=True,user_id='197723128bad419eb46ed73aac002de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Creating volume a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:30:57 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:30:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:57 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc 1073741824 Jun 15 07:30:57 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:58 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc 1073741824" returned: 0 in 1.020s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:30:58 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc Jun 15 07:30:58 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:30:59 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc" returned: 0 in 0.829s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0328334-aa06-4c32-9bb5-c11893153923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a652d3a1-5d13-4f60-be01-24b5733987dc', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbfdabe-c432-4cb9-a996-87a821e29285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:30:59 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Volume volume-a652d3a1-5d13-4f60-be01-24b5733987dc (a652d3a1-5d13-4f60-be01-24b5733987dc): created successfully Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fbfdabe-c432-4cb9-a996-87a821e29285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:30:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (6289e227-76fd-4340-a981-670831292ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:30:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-27a2068f-4c67-4e67-87b4-fca687b7d115 tempest-VolumesDeleteCascade-955253956 None] Created volume successfully. Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (91fe4ea8-7790-44b6-8091-1572fd6eb624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67935f17-4144-4656-b86e-a45cdf6e8503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67935f17-4144-4656-b86e-a45cdf6e8503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1890405692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b2a480-c0bf-4352-b69b-19afbe9d2a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:00Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06bb21a-8f77-423e-ae35-649678dd146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e06bb21a-8f77-423e-ae35-649678dd146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fe6893-77de-4940-8d7e-ef8f6afa6824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fe6893-77de-4940-8d7e-ef8f6afa6824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b2a480-c0bf-4352-b69b-19afbe9d2a65', 'volume_name': 'volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97ac0c2-9317-4547-9085-8ca4076fa8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97ac0c2-9317-4547-9085-8ca4076fa8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0999317c-a9d9-4e4e-8adb-946eaf457fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:00 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Volume 11b2a480-c0bf-4352-b69b-19afbe9d2a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65', 'volume_size': 1} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1890405692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b2a480-c0bf-4352-b69b-19afbe9d2a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:00Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Creating volume 11b2a480-c0bf-4352-b69b-19afbe9d2a65 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:00 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:00 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 1073741824 Jun 15 07:31:00 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:01 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 1073741824" returned: 0 in 1.036s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:01 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 Jun 15 07:31:01 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:02 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65" returned: 0 in 0.698s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.467s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0999317c-a9d9-4e4e-8adb-946eaf457fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e56cd65-831a-4993-93da-9a1e11a3a274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Creating offline snapshot bcd2fb61-2740-49e6-b879-a40aa839ae9a of volume a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Volume volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 (11b2a480-c0bf-4352-b69b-19afbe9d2a65): created successfully Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e56cd65-831a-4993-93da-9a1e11a3a274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (91fe4ea8-7790-44b6-8091-1572fd6eb624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9b54d8-e78e-4bcf-b6ff-a54a3f5264f6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-94188583-44a5-4a8b-bcc5-9e2f705b7a45 tempest-VolumesListTestJSON-996024965 None] Created volume successfully. Jun 15 07:31:02 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc Jun 15 07:31:02 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:03 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc" returned: 0 in 0.786s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:03 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a 1G Jun 15 07:31:03 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (cd8e9c77-dbde-4c07-9937-7bcab5354dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827175f3-f1cb-4818-8ad3-ffbf11c05de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827175f3-f1cb-4818-8ad3-ffbf11c05de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1650271365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8468b42f-ed95-426c-87e7-c909be59776f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:03Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fc455-16f9-4fe0-ac68-667eaa9c0886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4fc455-16f9-4fe0-ac68-667eaa9c0886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6c747-0366-41c3-b4b8-a8754e05b0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb6c747-0366-41c3-b4b8-a8754e05b0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8468b42f-ed95-426c-87e7-c909be59776f', 'volume_name': 'volume-8468b42f-ed95-426c-87e7-c909be59776f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c025bc-6bfe-4cff-9d41-1a279b88eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c025bc-6bfe-4cff-9d41-1a279b88eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481db144-912b-43d0-8f0f-5c118ff28e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:03 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Volume 8468b42f-ed95-426c-87e7-c909be59776f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8468b42f-ed95-426c-87e7-c909be59776f', 'volume_size': 1} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:03 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a 1G" returned: 0 in 0.755s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:03 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:03 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:04 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.659s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:04 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a is being set with open permissions: ugo+rw Jun 15 07:31:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:04 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:04 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:05 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.599s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:05 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info Jun 15 07:31:05 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:05 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info" returned: 0 in 0.571s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:05 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info is being set with open permissions: ugo+rw Jun 15 07:31:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:05 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info Jun 15 07:31:05 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:06 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.info" returned: 0 in 0.622s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.119s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.129s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1650271365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8468b42f-ed95-426c-87e7-c909be59776f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:03Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Creating volume 8468b42f-ed95-426c-87e7-c909be59776f {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:06 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:06 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f 1073741824 Jun 15 07:31:06 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-7ca2f9a6-f7a5-4473-888d-22538516673e tempest-VolumesDeleteCascade-955253956 None] Create snapshot completed successfully Jun 15 07:31:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:07 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f 1073741824" returned: 0 in 0.899s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:07 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f Jun 15 07:31:07 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:08 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f" returned: 0 in 0.645s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.152s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (481db144-912b-43d0-8f0f-5c118ff28e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8468b42f-ed95-426c-87e7-c909be59776f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b427dd1-e74f-4809-9564-9cc5c2a4cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3372f1-899e-46ab-95be-c6d0ab991cdc]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Volume volume-8468b42f-ed95-426c-87e7-c909be59776f (8468b42f-ed95-426c-87e7-c909be59776f): created successfully Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b427dd1-e74f-4809-9564-9cc5c2a4cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (cd8e9c77-dbde-4c07-9937-7bcab5354dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-74394a2f-a88e-45c1-80e7-dc5eedd813ee tempest-VolumesListTestJSON-996024965 None] Created volume successfully. Jun 15 07:31:08 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b Jun 15 07:31:08 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:08 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" returned: 0 in 0.842s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.893s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.553s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Creating offline snapshot 61559ba3-bc1a-4ac3-a688-0786b66c3f31 of volume a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bed568-5433-46f8-bf6b-8898d1d46ee4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fd35209-3f4e-47e1-a628-6118cc81fa97', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (3ddafd69-91cb-4c0a-bf54-e52e2989126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26742ee1-ea6f-424a-89d1-147a74a82e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26742ee1-ea6f-424a-89d1-147a74a82e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1999643769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a073ba9-bffe-46ad-8bb1-75bc397a1dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:09Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f98fe4f-6065-4c5c-819a-5fb4da175fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f98fe4f-6065-4c5c-819a-5fb4da175fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74646578-5950-4348-8ec0-315875318cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74646578-5950-4348-8ec0-315875318cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a073ba9-bffe-46ad-8bb1-75bc397a1dd6', 'volume_name': 'volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c23c770-725b-44ff-b74e-24c08e52d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c23c770-725b-44ff-b74e-24c08e52d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a3662-f168-401f-aa31-08d24e25f48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:09 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Volume 5a073ba9-bffe-46ad-8bb1-75bc397a1dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6', 'volume_size': 1} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:09 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:09 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-67b7c99c-cff9-400b-b4cc-c076e2a91138 req-a70109e0-7cc3-4a06-ba6f-587116dc3518 tempest-TestInstancesWithCinderVolumes-382288086 None] attachment_update completed successfully. Jun 15 07:31:09 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.786s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a652d3a1-5d13-4f60-be01-24b5733987dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:09 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 1G Jun 15 07:31:09 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:10 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 1G" returned: 0 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:10 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 Jun 15 07:31:10 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:11 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31" returned: 0 in 0.678s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:11 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 is being set with open permissions: ugo+rw Jun 15 07:31:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:11 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 Jun 15 07:31:11 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:12 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31" returned: 0 in 0.627s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Flow 'volume_create_manager' (f1635cab-c01a-440b-8065-8940fef4b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbfd3cd-8eda-4fd5-9c82-2a1a3ac517c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.140s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1999643769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a073ba9-bffe-46ad-8bb1-75bc397a1dd6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65715e1bd52f47ff8532825515b6fec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:09Z,use_quota=True,user_id='01b2a0753b3a4e2296e3e1e6b8ca0d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Creating volume 5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbfd3cd-8eda-4fd5-9c82-2a1a3ac517c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-862181890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee2a49e-d2be-48bb-a749-cc670be6ee0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec831958f7bc4b03a1fb704d025ab74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:12Z,use_quota=True,user_id='c83ee9b61c314fb49947c5b8c34f8e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ef506-88ac-412e-8c33-199955c36f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:12 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 1073741824 Jun 15 07:31:12 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63ef506-88ac-412e-8c33-199955c36f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30715697-28bb-4726-9778-2c474a3a567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30715697-28bb-4726-9778-2c474a3a567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee2a49e-d2be-48bb-a749-cc670be6ee0a', 'volume_name': 'volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab73e52-d12b-45e9-9f8e-241aea49f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab73e52-d12b-45e9-9f8e-241aea49f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb7de2d-6233-428e-b0a3-52f53236bbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Volume 4ee2a49e-d2be-48bb-a749-cc670be6ee0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a', 'volume_size': 1} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d13a67c6-9231-4917-bd2f-5cf08d3559b9 tempest-VolumesDeleteCascade-955253956 None] Create snapshot completed successfully Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-a652d3a1-5d13-4f60-be01-24b5733987dc-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-a652d3a1-5d13-4f60-be01-24b5733987dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Performing cascade delete. {{(pid=91865) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-61559ba3-bc1a-4ac3-a688-0786b66c3f31-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-61559ba3-bc1a-4ac3-a688-0786b66c3f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-61559ba3-bc1a-4ac3-a688-0786b66c3f31" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-61559ba3-bc1a-4ac3-a688-0786b66c3f31" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Deleting offline snapshot 61559ba3-bc1a-4ac3-a688-0786b66c3f31 of volume a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] snapshot_file for this snap is: volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d2842b-a35e-4824-8339-99eff3905066]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:12 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 Jun 15 07:31:12 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:12 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 1073741824" returned: 0 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:13 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 Jun 15 07:31:13 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:13 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31" returned: 0 in 0.780s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a652d3a1-5d13-4f60-be01-24b5733987dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8bb599-d68d-40b0-8921-95c84f0f71e5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:13 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" returned: 0 in 0.621s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-862181890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee2a49e-d2be-48bb-a749-cc670be6ee0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec831958f7bc4b03a1fb704d025ab74e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:12Z,use_quota=True,user_id='c83ee9b61c314fb49947c5b8c34f8e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Creating volume 4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:13 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:13 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a 1073741824 Jun 15 07:31:13 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a3662-f168-401f-aa31-08d24e25f48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2644f63b-3977-469d-b31d-bda753ae9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Volume volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 (5a073ba9-bffe-46ad-8bb1-75bc397a1dd6): created successfully Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2644f63b-3977-469d-b31d-bda753ae9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Flow 'volume_create_manager' (3ddafd69-91cb-4c0a-bf54-e52e2989126d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-00792a03-de85-43c7-a756-9dc176f0a59c tempest-VolumesListTestJSON-996024965 None] Created volume successfully. Jun 15 07:31:13 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:13 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:14 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a652d3a1-5d13-4f60-be01-24b5733987dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:14 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 Jun 15 07:31:14 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:14 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a 1073741824" returned: 0 in 0.843s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:14 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a Jun 15 07:31:14 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:15 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" returned: 0 in 0.648s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb7de2d-6233-428e-b0a3-52f53236bbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fa13a9-8f81-4349-9192-9196e9711e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Volume volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a (4ee2a49e-d2be-48bb-a749-cc670be6ee0a): created successfully Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fa13a9-8f81-4349-9192-9196e9711e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:15 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Flow 'volume_create_manager' (f1635cab-c01a-440b-8065-8940fef4b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31" returned: 0 in 0.858s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-46ff25e0-a130-43b1-8b7c-dd05f8ebb818 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Created volume successfully. Jun 15 07:31:15 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31 Jun 15 07:31:15 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:15 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.61559ba3-bc1a-4ac3-a688-0786b66c3f31" returned: 0 in 0.613s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-61559ba3-bc1a-4ac3-a688-0786b66c3f31" released by "_delete_snapshot" :: held 3.117s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" released by "delete_snapshot" :: held 3.142s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:15 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Created reservations ['397243db-3638-492c-98fd-97384731a322', '0a6a97ee-ff01-4815-a7c1-e30a7840b449', '77761e78-f38a-4941-8813-225e0c9ee361', 'f7216dc5-9493-48e4-9d6c-e7e49cd259b8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Delete snapshot completed successfully. Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-61559ba3-bc1a-4ac3-a688-0786b66c3f31-delete_snapshot" released by "delete_snapshot" :: held 3.336s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-bcd2fb61-2740-49e6-b879-a40aa839ae9a-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-bcd2fb61-2740-49e6-b879-a40aa839ae9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" acquired by "delete_snapshot" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-bcd2fb61-2740-49e6-b879-a40aa839ae9a" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-bcd2fb61-2740-49e6-b879-a40aa839ae9a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Deleting offline snapshot bcd2fb61-2740-49e6-b879-a40aa839ae9a of volume a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] snapshot_file for this snap is: volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92fa04b-28ad-4388-8692-f5aebbad885d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:16 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:16 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Creating offline snapshot 5553a2d3-e409-48f8-91a1-e0dda0c48447 of volume 4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ddaa80-cd52-4e38-afd4-ebb6410c07b6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:16 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a Jun 15 07:31:16 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "cinder-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-quobyte-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ac1624-3e8b-4341-8d43-fb42be294915]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:17 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 1.014s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a652d3a1-5d13-4f60-be01-24b5733987dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c848d336-1998-4676-90b7-1b706a6785dd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:17 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 Jun 15 07:31:17 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:17 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc Jun 15 07:31:17 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:17 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:17 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 1G Jun 15 07:31:17 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:17 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" returned: 0 in 0.748s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:17 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6 Jun 15 07:31:17 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc" returned: 0 in 0.795s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:18 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 1G" returned: 0 in 0.836s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 Jun 15 07:31:18 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" returned: 0 in 0.677s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6" released by "delete_volume" :: held 1.471s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Created reservations ['98ddc335-d5b3-402c-9712-b61ce24d4031', '435ff6a6-2b45-44b0-8c3a-916ed14cc639', '8203aa99-c18c-4abc-877b-26d9ab8d2bb4', 'af3d459d-0be0-4ef2-86ea-a4ede29c8107'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:18 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.818s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a Jun 15 07:31:18 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:18 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447" returned: 0 in 0.715s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:18 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 is being set with open permissions: ugo+rw Jun 15 07:31:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:18 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 Jun 15 07:31:18 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-8468b42f-ed95-426c-87e7-c909be59776f-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-8468b42f-ed95-426c-87e7-c909be59776f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-quobyte-8468b42f-ed95-426c-87e7-c909be59776f" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-8468b42f-ed95-426c-87e7-c909be59776f" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:19 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.715s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Deleted volume successfully. Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[972f8a0f-4077-4798-a828-d8f1e13d1a82]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-22498cb3-7f39-4aa7-abda-15b66ebe004b tempest-VolumesListTestJSON-996024965 None] Lock "cinder-5a073ba9-bffe-46ad-8bb1-75bc397a1dd6-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:19 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc.bcd2fb61-2740-49e6-b879-a40aa839ae9a" returned: 0 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-bcd2fb61-2740-49e6-b879-a40aa839ae9a" released by "_delete_snapshot" :: held 3.423s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" released by "delete_snapshot" :: held 3.461s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:19 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f Jun 15 07:31:19 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Created reservations ['6dafb14d-c8b6-4c79-8fc9-67bd10cbbd26', '74c79b3e-9606-4cec-9b88-2606af186ccb', 'a4e2529b-4c2a-4373-924f-43d10cf6629e', '435707a3-b8ef-4789-9916-c4a616da40b2'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:19 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Delete snapshot completed successfully. Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-bcd2fb61-2740-49e6-b879-a40aa839ae9a-delete_snapshot" released by "delete_snapshot" :: held 3.638s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Snapshots deleted, issuing volume delete {{(pid=91865) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:19 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info Jun 15 07:31:19 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b088806d-988b-49a6-a458-e2f6c1498707]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:19 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc Jun 15 07:31:19 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f" returned: 0 in 0.761s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f Jun 15 07:31:20 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info" returned: 0 in 0.668s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info is being set with open permissions: ugo+rw Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info Jun 15 07:31:20 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc" returned: 0 in 0.764s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc Jun 15 07:31:20 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:20 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8468b42f-ed95-426c-87e7-c909be59776f" returned: 0 in 0.592s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-8468b42f-ed95-426c-87e7-c909be59776f" released by "delete_volume" :: held 1.414s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Created reservations ['e258f164-07dc-4b7c-91eb-bafb9bc93c7b', 'c0d6147b-8006-4ab7-82ba-63afb070be20', '93e2a011-d424-4547-9d7c-5eec296bddb9', 'dfd489f6-ce95-487c-abba-da7822595572'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:20 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:20 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:21 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.info" returned: 0 in 0.636s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.463s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.965s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4f893-5b14-4401-9e0a-7b356013cacc]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-54e990cd-415c-42cb-8e89-a15cefd92dd2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Create snapshot completed successfully Jun 15 07:31:21 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 Jun 15 07:31:21 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:21 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a652d3a1-5d13-4f60-be01-24b5733987dc" returned: 0 in 0.656s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-a652d3a1-5d13-4f60-be01-24b5733987dc" released by "delete_volume" :: held 1.516s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Created reservations ['8c9e8949-ff49-47e9-aef8-49fe816bdec3', 'fc4ac318-3ed1-45d9-b903-2734ebc562da', '53eca5e8-3a61-40b7-b0e7-9396e653d7bd', 'fcd5c64f-877e-4083-95d1-93e38619393f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:21 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:21 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:21 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.653s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Deleted volume successfully. Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6322484c-da47-4b88-a2b2-ec2bcbe89fe7 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-8468b42f-ed95-426c-87e7-c909be59776f-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-11b2a480-c0bf-4352-b69b-19afbe9d2a65-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-11b2a480-c0bf-4352-b69b-19afbe9d2a65-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "cinder-quobyte-11b2a480-c0bf-4352-b69b-19afbe9d2a65" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-11b2a480-c0bf-4352-b69b-19afbe9d2a65" acquired by "delete_volume" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05ce78-4174-42b0-9d45-b1b87bc76ab4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:21 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46" returned: 0 in 0.837s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.860s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe608320-2480-44b4-82cb-2617d7152bdc', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:31:21 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 Jun 15 07:31:21 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-66ead729-36ea-4fa3-84c3-23231dc5805f req-e7d3c76f-d9c8-4b6f-97fb-27fca99e36b4 tempest-TestInstancesWithCinderVolumes-382288086 None] attachment_update completed successfully. Jun 15 07:31:22 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Deleted volume successfully. Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3f8c0886-c4b3-4d72-bdcd-f0c792ce617a tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-a652d3a1-5d13-4f60-be01-24b5733987dc-delete_volume" released by "delete_volume" :: held 9.496s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "cinder-5553a2d3-e409-48f8-91a1-e0dda0c48447-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-5553a2d3-e409-48f8-91a1-e0dda0c48447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "cinder-quobyte-5553a2d3-e409-48f8-91a1-e0dda0c48447" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-5553a2d3-e409-48f8-91a1-e0dda0c48447" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Deleting offline snapshot 5553a2d3-e409-48f8-91a1-e0dda0c48447 of volume 4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] snapshot_file for this snap is: volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd948d-4c2a-4d1c-bfe8-8984dd78f514]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:22 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65" returned: 0 in 0.810s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:22 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65 Jun 15 07:31:22 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:22 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 Jun 15 07:31:22 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (f2ab07f4-cf6e-4475-91a0-cf07b4369641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef85499b-3fcb-4f44-8240-5654fa9f13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef85499b-3fcb-4f44-8240-5654fa9f13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1014036661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3299cfe9-17fe-4e25-b9e8-f5cd824536c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a57a152bd4a70820a85c832f7d475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:23Z,use_quota=True,user_id='197723128bad419eb46ed73aac002de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e270b113-0a1b-4d4a-a66d-ff166501c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e270b113-0a1b-4d4a-a66d-ff166501c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590d5223-3d3e-498a-a9ec-ee35be00e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590d5223-3d3e-498a-a9ec-ee35be00e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3299cfe9-17fe-4e25-b9e8-f5cd824536c2', 'volume_name': 'volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317ed149-f472-4192-893c-0f57ceab948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317ed149-f472-4192-893c-0f57ceab948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ff0b0e-9dbb-414e-9c6e-12d456046728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:23 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Volume 3299cfe9-17fe-4e25-b9e8-f5cd824536c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2', 'volume_size': 1} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1014036661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3299cfe9-17fe-4e25-b9e8-f5cd824536c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a57a152bd4a70820a85c832f7d475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:23Z,use_quota=True,user_id='197723128bad419eb46ed73aac002de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Creating volume 3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:23 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:23 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 1073741824 Jun 15 07:31:23 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:23 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:23 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447" returned: 0 in 0.823s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11b2a480-c0bf-4352-b69b-19afbe9d2a65" returned: 0 in 0.777s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0995b7b-2fa9-4bad-b28f-915debef6e01]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-quobyte-11b2a480-c0bf-4352-b69b-19afbe9d2a65" released by "delete_volume" :: held 1.647s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Created reservations ['11bc0ee0-87ae-4860-bc1b-67642fbfab11', '6b32f3ae-1c68-47f9-9fb3-555368151518', '2b263c53-de92-48b2-8a23-0cc29a1d10a3', 'e17c109c-f6cb-416d-8427-039dc58592ca'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:23 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a Jun 15 07:31:23 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:23 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:23 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:24 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 1073741824" returned: 0 in 0.905s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:24 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:24 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:24 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.699s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Deleted volume successfully. Jun 15 07:31:24 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" returned: 0 in 0.872s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-267042b7-a2dd-48ef-9db9-f4094129a0e1 tempest-VolumesListTestJSON-996024965 None] Lock "cinder-11b2a480-c0bf-4352-b69b-19afbe9d2a65-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:24 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 Jun 15 07:31:24 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:24 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ff0b0e-9dbb-414e-9c6e-12d456046728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a52f94-ca3d-45b3-995b-ee841e5715b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Volume volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 (3299cfe9-17fe-4e25-b9e8-f5cd824536c2): created successfully Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a52f94-ca3d-45b3-995b-ee841e5715b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (f2ab07f4-cf6e-4475-91a0-cf07b4369641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e9c32758-d767-4b9b-ab07-43dfb760920e tempest-VolumesDeleteCascade-955253956 None] Created volume successfully. Jun 15 07:31:25 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447" returned: 0 in 0.771s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:25 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447 Jun 15 07:31:25 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Creating offline snapshot b1da611a-cc1e-42e4-8901-0ce1a1c0344c of volume 3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[01734850-ec02-4fdb-9a92-ff8b7ba7d545]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:25 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:25 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:25 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a.5553a2d3-e409-48f8-91a1-e0dda0c48447" returned: 0 in 0.737s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-5553a2d3-e409-48f8-91a1-e0dda0c48447" released by "_delete_snapshot" :: held 3.330s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" released by "delete_snapshot" :: held 3.356s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:25 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Created reservations ['316f5301-bd37-4577-b86f-3a38ad452e23', '4846f681-d848-4590-b2ad-22028f14eb40', '678e2088-5750-4432-81a3-f04a1b00eeb9', 'aadd90dd-cb08-46b0-b63b-d3ceca2b517c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Delete snapshot completed successfully. Jun 15 07:31:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ce40805e-5891-41f4-8718-6aa95bece5dd tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-5553a2d3-e409-48f8-91a1-e0dda0c48447-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:26 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 0.787s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:26 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c 1G Jun 15 07:31:26 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "cinder-4ee2a49e-d2be-48bb-a749-cc670be6ee0a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-4ee2a49e-d2be-48bb-a749-cc670be6ee0a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[54811111-84e1-4984-a0b4-3dcfe5eae512]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (dd708157-5caf-464b-b448-c332930f42ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f797fe89-7d8f-4752-a2f6-9195032e6c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f797fe89-7d8f-4752-a2f6-9195032e6c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502974146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445ac785-264b-40b6-8f28-f7c65296ba03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:27Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5c78f7-aa97-4d1d-988f-bfe90985556f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5c78f7-aa97-4d1d-988f-bfe90985556f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614ddf9a-8457-464b-8e09-8f6b988386b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614ddf9a-8457-464b-8e09-8f6b988386b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445ac785-264b-40b6-8f28-f7c65296ba03', 'volume_name': 'volume-445ac785-264b-40b6-8f28-f7c65296ba03', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd95e9b-1ee7-42d8-9dfe-232b603cc8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:27 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a Jun 15 07:31:27 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd95e9b-1ee7-42d8-9dfe-232b603cc8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b20f395-9f37-48c7-ac86-12ac0d3aa837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:27 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume 445ac785-264b-40b6-8f28-f7c65296ba03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445ac785-264b-40b6-8f28-f7c65296ba03', 'volume_size': 1} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:27 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c 1G" returned: 0 in 1.005s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:27 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:27 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:28 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" returned: 0 in 1.037s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:28 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a Jun 15 07:31:28 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:28 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 0.822s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:28 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c is being set with open permissions: ugo+rw Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:28 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:28 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:28 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" returned: 0 in 0.696s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-quobyte-4ee2a49e-d2be-48bb-a749-cc670be6ee0a" released by "delete_volume" :: held 1.807s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Created reservations ['2fe33811-e70b-4416-bdcf-9026ca3b9388', '3990f42b-8adc-419e-9389-90b119a2920c', '7f1a67e9-f70a-4243-a6cf-10f4f560cb97', '58ed2f5d-ecdb-49f0-a749-a475959b18df'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:28 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 0.706s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:29 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info Jun 15 07:31:29 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:29 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:29 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:29 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info" returned: 0 in 0.642s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:29 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info is being set with open permissions: ugo+rw Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:29 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info Jun 15 07:31:29 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:29 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.702s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:29 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Deleted volume successfully. Jun 15 07:31:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d70c3a53-32a2-462e-bfd7-9e5b592cd658 tempest-VolumeSnapshotQuotasNegativeTestJSON-1573312916 None] Lock "cinder-4ee2a49e-d2be-48bb-a749-cc670be6ee0a-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:30 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.info" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.768s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.055s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502974146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445ac785-264b-40b6-8f28-f7c65296ba03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:27Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume 445ac785-264b-40b6-8f28-f7c65296ba03 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:30 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:30 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 1073741824 Jun 15 07:31:30 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6d229722-3380-451b-851f-258c15d018bc tempest-VolumesDeleteCascade-955253956 None] Create snapshot completed successfully Jun 15 07:31:31 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 1073741824" returned: 0 in 0.852s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:31 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 Jun 15 07:31:31 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (7a638280-1b41-4f59-92d2-cf960b518681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea84080-dbe1-42fc-8766-7c681608a849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea84080-dbe1-42fc-8766-7c681608a849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997493892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e062a2-4a4a-4826-9de6-1483781ee363,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a57a152bd4a70820a85c832f7d475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1da611a-cc1e-42e4-8901-0ce1a1c0344c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:31Z,use_quota=True,user_id='197723128bad419eb46ed73aac002de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df747d-b59d-41d1-af76-e6af15f0b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80df747d-b59d-41d1-af76-e6af15f0b084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fb2011-779b-48b7-9dc6-ab2c20d89417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fb2011-779b-48b7-9dc6-ab2c20d89417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4e062a2-4a4a-4826-9de6-1483781ee363', 'volume_name': 'volume-c4e062a2-4a4a-4826-9de6-1483781ee363', 'volume_size': 1, 'snapshot_id': 'b1da611a-cc1e-42e4-8901-0ce1a1c0344c'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdae3a6a-ed8e-47d6-a301-c33d71306e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdae3a6a-ed8e-47d6-a301-c33d71306e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d967d3b-3b40-4cc8-be0b-79808f6968c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:31 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Volume c4e062a2-4a4a-4826-9de6-1483781ee363: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4e062a2-4a4a-4826-9de6-1483781ee363', 'volume_size': 1, 'snapshot_id': 'b1da611a-cc1e-42e4-8901-0ce1a1c0344c'} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-9451df2c-8b8e-4f6b-9e3e-eaf1e2134445 req-9cde8ab8-f187-4a62-8cf5-a959f361daa7 tempest-TestInstancesWithCinderVolumes-382288086 None] Terminate volume connection completed successfully. Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-9451df2c-8b8e-4f6b-9e3e-eaf1e2134445 req-9cde8ab8-f187-4a62-8cf5-a959f361daa7 tempest-TestInstancesWithCinderVolumes-382288086 None] Deleting attachment 9fd35209-3f4e-47e1-a628-6118cc81fa97. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:31:31 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03" returned: 0 in 0.739s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.455s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-c4e062a2-4a4a-4826-9de6-1483781ee363" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-c4e062a2-4a4a-4826-9de6-1483781ee363" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Creating volume c4e062a2-4a4a-4826-9de6-1483781ee363 from snapshot b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b20f395-9f37-48c7-ac86-12ac0d3aa837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445ac785-264b-40b6-8f28-f7c65296ba03', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498dea11-64d7-434e-8728-541f44eb8a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] snapshot: b1da611a-cc1e-42e4-8901-0ce1a1c0344c, volume: c4e062a2-4a4a-4826-9de6-1483781ee363, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:31:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-445ac785-264b-40b6-8f28-f7c65296ba03 (445ac785-264b-40b6-8f28-f7c65296ba03): created successfully Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498dea11-64d7-434e-8728-541f44eb8a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (dd708157-5caf-464b-b448-c332930f42ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-95cfe563-e18e-414d-803e-18e15458715e tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ea624-0f57-4077-95c3-cc8a0dae3dbd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:32 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:32 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:32 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f2709-9246-4b10-bd8f-e01a517f2a80]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (e1f07443-3aef-4cf7-b88b-c95ae6978de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:33 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:33 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ebdc5-9347-49e7-9af6-6585379e2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ebdc5-9347-49e7-9af6-6585379e2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1640987599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7454c4e-bf8e-4974-a853-ba81df8c44a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:33Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4d3ecb-4361-4444-bb07-86e84142aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4d3ecb-4361-4444-bb07-86e84142aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6205dd9-3b39-4ab3-91c0-3a13b72d1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6205dd9-3b39-4ab3-91c0-3a13b72d1366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7454c4e-bf8e-4974-a853-ba81df8c44a6', 'volume_name': 'volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed796695-dfda-4f5e-a768-52689015eb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed796695-dfda-4f5e-a768-52689015eb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ccd611-b3ca-4391-a168-3ca0d5866b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume b7454c4e-bf8e-4974-a853-ba81df8c44a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6', 'volume_size': 1} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (9d9973ce-68c6-44df-954c-8aad3425e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39654352-a2cf-4745-9140-16f4ea7e9e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39654352-a2cf-4745-9140-16f4ea7e9e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517854580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749f612-ee13-4827-8ada-25bb042897fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:33Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984fdf00-24f5-4953-96a3-c9c655435b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984fdf00-24f5-4953-96a3-c9c655435b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde721ec-c59b-4ff9-bbd7-d47756721e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde721ec-c59b-4ff9-bbd7-d47756721e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8749f612-ee13-4827-8ada-25bb042897fd', 'volume_name': 'volume-8749f612-ee13-4827-8ada-25bb042897fd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bc5268-3de2-4ad2-ba47-3403be817900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bc5268-3de2-4ad2-ba47-3403be817900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a08f2e-680b-4b34-98bc-2d4f8fa6e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume 8749f612-ee13-4827-8ada-25bb042897fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8749f612-ee13-4827-8ada-25bb042897fd', 'volume_size': 1} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-f01fa6dc-eaa0-4125-b51e-d55a6f62337b-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:33 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 0.891s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-f01fa6dc-eaa0-4125-b51e-d55a6f62337b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:33 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 Jun 15 07:31:33 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-quobyte-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a0b117-4132-472a-9325-ccf93530b693]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (defc51c1-f239-47d4-a0bc-3c4539e8c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfe3118-3e95-4c3d-addb-d28e65ea5a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfe3118-3e95-4c3d-addb-d28e65ea5a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158417607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc833e-83cc-454c-9116-7ee7e11b7e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:34Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b Jun 15 07:31:34 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f2ec71-8518-4fe3-9be8-ced2de585d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f2ec71-8518-4fe3-9be8-ced2de585d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe9f32a-a90a-4126-acf5-f174272d3d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe9f32a-a90a-4126-acf5-f174272d3d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cc833e-83cc-454c-9116-7ee7e11b7e72', 'volume_name': 'volume-93cc833e-83cc-454c-9116-7ee7e11b7e72', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0186eeb4-fc68-4555-afb4-68f7a33611d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0186eeb4-fc68-4555-afb4-68f7a33611d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dcf7a0-4aef-4622-80f0-d16c0c923785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume 93cc833e-83cc-454c-9116-7ee7e11b7e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cc833e-83cc-454c-9116-7ee7e11b7e72', 'volume_size': 1} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (baf3aa03-f07f-4b04-ba15-d59764f1b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25620f-c329-417f-81d6-2830823bcbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c25620f-c329-417f-81d6-2830823bcbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905308335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50260acd-357d-4789-9091-74aed5c08f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:35Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ae17a-4e03-4111-bdf5-b219fab1f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ae17a-4e03-4111-bdf5-b219fab1f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0893e8dc-8653-4b0d-bbc6-ae40caced3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0893e8dc-8653-4b0d-bbc6-ae40caced3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50260acd-357d-4789-9091-74aed5c08f9b', 'volume_name': 'volume-50260acd-357d-4789-9091-74aed5c08f9b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc95303-9471-4817-a1c2-46d3994cad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc95303-9471-4817-a1c2-46d3994cad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c885a6d-3f0a-4be0-90ba-6ea55ef7fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume 50260acd-357d-4789-9091-74aed5c08f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50260acd-357d-4789-9091-74aed5c08f9b', 'volume_size': 1} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (acc6e193-39f9-4e3a-9443-48d532034d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d652d98-43a6-4e3c-ae8f-26d344fa3c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d652d98-43a6-4e3c-ae8f-26d344fa3c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435700705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc75714-d760-48d2-9fe6-84a186f2d204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:35Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c09487-e631-4284-b0c7-ffdf03ee1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c09487-e631-4284-b0c7-ffdf03ee1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94304626-eb63-4ab6-a659-4124a6bcba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94304626-eb63-4ab6-a659-4124a6bcba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc75714-d760-48d2-9fe6-84a186f2d204', 'volume_name': 'volume-5bc75714-d760-48d2-9fe6-84a186f2d204', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9060d51-1e3b-4be7-9cc5-b87170a28425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9060d51-1e3b-4be7-9cc5-b87170a28425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664e75b3-bdec-4a38-9e90-fb85c6311b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:35 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume 5bc75714-d760-48d2-9fe6-84a186f2d204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc75714-d760-48d2-9fe6-84a186f2d204', 'volume_size': 1} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:35 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" returned: 0 in 1.190s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:35 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b Jun 15 07:31:35 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:36 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" returned: 0 in 1.156s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-f01fa6dc-eaa0-4125-b51e-d55a6f62337b" released by "delete_volume" :: held 2.480s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:36 devstack cinder-volume[91865]: WARNING cinder.quota [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2000585497-627120535 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2000585497-627120535, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:36 devstack cinder-volume[91865]: WARNING cinder.quota [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2000585497-627120535 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2000585497-627120535, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Created reservations ['ef1d6513-408b-4db4-8641-f181f9192733', '0f3a2647-967f-4a73-aee9-feaec049d288', 'f81787a6-b81b-4634-a5ee-40410bbb011d', '38b1d5e6-0c04-4e87-a527-094bfacaf454'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:36 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:36 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:38 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.358s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:38 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Deleted volume successfully. Jun 15 07:31:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fbdaa9d-e9bd-4390-8ffb-f1cf153448de tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-f01fa6dc-eaa0-4125-b51e-d55a6f62337b-delete_volume" released by "delete_volume" :: held 4.346s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:40 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363" returned: 0 in 6.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:40 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ae705c-8362-4d1f-a46c-fb342d6f8f7b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:40 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-691457d3-e34f-4b85-b05f-7abb3353da3c req-faebd9f7-29b7-4345-9404-c7df2c2504b9 tempest-TestInstancesWithCinderVolumes-382288086 None] Terminate volume connection completed successfully. Jun 15 07:31:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-691457d3-e34f-4b85-b05f-7abb3353da3c req-faebd9f7-29b7-4345-9404-c7df2c2504b9 tempest-TestInstancesWithCinderVolumes-382288086 None] Deleting attachment fe608320-2480-44b4-82cb-2617d7152bdc. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:31:40 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:40 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:41 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 0.877s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:41 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:31:41 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Converted 1024.00 MB image at 150.99 MB/s Jun 15 07:31:41 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 is being set with open permissions: ugo+rw Jun 15 07:31:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:41 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 Jun 15 07:31:41 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:42 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363" returned: 0 in 0.624s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" released by "_copy_volume_from_snapshot" :: held 10.039s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-c4e062a2-4a4a-4826-9de6-1483781ee363" released by "_create_volume_from_snapshot" :: held 10.099s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.115s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.974s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1640987599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7454c4e-bf8e-4974-a853-ba81df8c44a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:33Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume b7454c4e-bf8e-4974-a853-ba81df8c44a6 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:42 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:42 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 1073741824 Jun 15 07:31:42 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d967d3b-3b40-4cc8-be0b-79808f6968c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e062a2-4a4a-4826-9de6-1483781ee363', 'volume_size': 1, 'snapshot_id': 'b1da611a-cc1e-42e4-8901-0ce1a1c0344c'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c236b458-f221-49e3-a884-31e0e22a4ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:42 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Volume volume-c4e062a2-4a4a-4826-9de6-1483781ee363 (c4e062a2-4a4a-4826-9de6-1483781ee363): created successfully Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c236b458-f221-49e3-a884-31e0e22a4ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Flow 'volume_create_manager' (7a638280-1b41-4f59-92d2-cf960b518681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ac731331-0b19-4d57-8c38-371725d7e911 tempest-VolumesDeleteCascade-955253956 None] Created volume successfully. Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-629ff970-5132-4a5b-8a4d-ee19f9b66a46-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-629ff970-5132-4a5b-8a4d-ee19f9b66a46-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-quobyte-629ff970-5132-4a5b-8a4d-ee19f9b66a46" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-629ff970-5132-4a5b-8a4d-ee19f9b66a46" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79834c9-ceb1-4048-9d9d-8f2bcb9338f4]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:42 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 Jun 15 07:31:42 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-3299cfe9-17fe-4e25-b9e8-f5cd824536c2-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-3299cfe9-17fe-4e25-b9e8-f5cd824536c2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Performing cascade delete. {{(pid=91865) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Deleting offline snapshot b1da611a-cc1e-42e4-8901-0ce1a1c0344c of volume 3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] snapshot_file for this snap is: volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b98e808-4f9b-4602-ac0b-c794ae02993f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:43 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:43 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:43 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 1073741824" returned: 0 in 1.179s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:43 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 Jun 15 07:31:43 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:43 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46" returned: 0 in 1.208s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:43 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46 Jun 15 07:31:43 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:44 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 0.989s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f107343-9745-44ea-9ecf-0ffcc24d5fab]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:44 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:44 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:44 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6" returned: 0 in 0.942s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.789s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1517854580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8749f612-ee13-4827-8ada-25bb042897fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:33Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume 8749f612-ee13-4827-8ada-25bb042897fd {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:44 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:44 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd 1073741824 Jun 15 07:31:44 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ccd611-b3ca-4391-a168-3ca0d5866b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4145341b-6da7-4048-b304-e21e0165552b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 (b7454c4e-bf8e-4974-a853-ba81df8c44a6): created successfully Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4145341b-6da7-4048-b304-e21e0165552b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (e1f07443-3aef-4cf7-b88b-c95ae6978de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-85349060-d2f2-48d5-8543-1cbb279dcb01 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:44 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-629ff970-5132-4a5b-8a4d-ee19f9b66a46" returned: 0 in 1.028s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-629ff970-5132-4a5b-8a4d-ee19f9b66a46" released by "delete_volume" :: held 2.302s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:44 devstack cinder-volume[91865]: WARNING cinder.quota [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-380801967-848653717 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-380801967-848653717, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:44 devstack cinder-volume[91865]: WARNING cinder.quota [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-380801967-848653717 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-380801967-848653717, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Created reservations ['3e70271b-20fa-4760-92c6-1abf8e2c5bbf', '41932fed-a56b-4f40-a94f-e6e618982163', '724a1285-ea63-4bad-a44d-59555d8e3d30', '41d1fe1f-5386-4fac-9951-1760c04e9f82'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:45 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:45 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:45 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 1.162s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:45 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:45 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:45 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd 1073741824" returned: 0 in 1.538s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:45 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd Jun 15 07:31:45 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:46 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.039s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Deleted volume successfully. Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2529243a-65aa-4c93-a89e-43fdb44108f5 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-629ff970-5132-4a5b-8a4d-ee19f9b66a46-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:46 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 1.073s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:46 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c Jun 15 07:31:46 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:46 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:46 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:46 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd" returned: 0 in 0.852s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (2492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.516s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1158417607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc833e-83cc-454c-9116-7ee7e11b7e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:34Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume 93cc833e-83cc-454c-9116-7ee7e11b7e72 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:46 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a08f2e-680b-4b34-98bc-2d4f8fa6e23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8749f612-ee13-4827-8ada-25bb042897fd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:46 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 1073741824 Jun 15 07:31:46 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2815f5f6-d564-4982-a62f-10d1346eeb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-8749f612-ee13-4827-8ada-25bb042897fd (8749f612-ee13-4827-8ada-25bb042897fd): created successfully Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2815f5f6-d564-4982-a62f-10d1346eeb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (9d9973ce-68c6-44df-954c-8aad3425e119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-87198d79-6346-40dc-a9e4-ff0f8b0bac77 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:47 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2.b1da611a-cc1e-42e4-8901-0ce1a1c0344c" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-b1da611a-cc1e-42e4-8901-0ce1a1c0344c" released by "_delete_snapshot" :: held 4.259s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" released by "delete_snapshot" :: held 4.289s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Created reservations ['bac5efb9-166c-48b2-bc05-b45216787a64', 'ebf4d824-f69b-4b06-afc0-036921f143d8', '91ede249-741c-479c-a373-379e8647aef5', '34b4d3cd-9497-497a-b171-8863bd4df942'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:47 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.927s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:31:47 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Delete snapshot completed successfully. Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-b1da611a-cc1e-42e4-8901-0ce1a1c0344c-delete_snapshot" released by "delete_snapshot" :: held 4.764s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Snapshots deleted, issuing volume delete {{(pid=91865) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" acquired by "delete_volume" :: waited 0.036s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[481714e4-2c94-4b71-92ac-350dd581415b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:47 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:47 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:48 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 1073741824" returned: 0 in 1.319s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:48 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 Jun 15 07:31:48 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:48 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 1.053s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:48 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2 Jun 15 07:31:48 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:49 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72" returned: 0 in 0.899s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (2316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.341s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1905308335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50260acd-357d-4789-9091-74aed5c08f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:35Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume 50260acd-357d-4789-9091-74aed5c08f9b {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:49 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:49 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b 1073741824 Jun 15 07:31:49 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dcf7a0-4aef-4622-80f0-d16c0c923785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cc833e-83cc-454c-9116-7ee7e11b7e72', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e46ab5-307d-4762-85b2-98383c2af152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 (93cc833e-83cc-454c-9116-7ee7e11b7e72): created successfully Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e46ab5-307d-4762-85b2-98383c2af152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (defc51c1-f239-47d4-a0bc-3c4539e8c707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-272e0cfc-9587-43b5-90e0-9de7b8049fca tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:49 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" returned: 0 in 0.994s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-3299cfe9-17fe-4e25-b9e8-f5cd824536c2" released by "delete_volume" :: held 2.134s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:49 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Created reservations ['2d4f7953-267b-4deb-96a1-295c7459850f', '0440023b-fbb2-4583-aff9-cdf448e72ceb', 'f391668f-9739-402d-93a5-f29069562b7a', '1cca2f18-e79e-4ef9-9697-44aede3027f8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:50 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:50 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:50 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b 1073741824" returned: 0 in 1.121s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:50 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b Jun 15 07:31:50 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:50 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Deleted volume successfully. Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ac3d0b0f-5cb9-4130-9001-8667c73790ba tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-3299cfe9-17fe-4e25-b9e8-f5cd824536c2-delete_volume" released by "delete_volume" :: held 7.895s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-a63c1ef9-cb1c-4c5b-9757-2cb53be8c688 req-1caf1339-bc5e-4711-a542-9cea1eb4f687 tempest-TestInstancesWithCinderVolumes-382288086 None] Terminate volume connection completed successfully. Jun 15 07:31:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-a63c1ef9-cb1c-4c5b-9757-2cb53be8c688 req-1caf1339-bc5e-4711-a542-9cea1eb4f687 tempest-TestInstancesWithCinderVolumes-382288086 None] Deleting attachment d9e39f17-fd12-466b-af5d-4e2d3dbd43cf. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:31:51 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b" returned: 0 in 0.662s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.895s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1435700705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc75714-d760-48d2-9fe6-84a186f2d204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e81425008f9444a084808b7d8bca96ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:35Z,use_quota=True,user_id='f27210e7a4054d76b555acb917ea7e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Creating volume 5bc75714-d760-48d2-9fe6-84a186f2d204 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:51 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:51 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 1073741824 Jun 15 07:31:51 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c885a6d-3f0a-4be0-90ba-6ea55ef7fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50260acd-357d-4789-9091-74aed5c08f9b', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbffaad-e1f1-4a62-9edb-b5d05fe7efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-50260acd-357d-4789-9091-74aed5c08f9b (50260acd-357d-4789-9091-74aed5c08f9b): created successfully Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbffaad-e1f1-4a62-9edb-b5d05fe7efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (baf3aa03-f07f-4b04-ba15-d59764f1b386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6437f17c-9023-4aa1-b67c-ff5625dd3a31 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Flow 'volume_create_manager' (7eb3938c-679e-4685-b721-93d069b79796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d9bf7-5ef5-4ac0-96e7-05392ef85d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d9bf7-5ef5-4ac0-96e7-05392ef85d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1165985422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7402703f-a7dd-4f54-9f76-89a63bcc80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071f6741304748488149d83aa4b3fb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:51Z,use_quota=True,user_id='3716f47183814b55bd09a74ef98a16de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345ad8c-3928-49c4-b272-7d1f50199af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2345ad8c-3928-49c4-b272-7d1f50199af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5604f71e-dc4f-4c18-be14-bae9ab158f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5604f71e-dc4f-4c18-be14-bae9ab158f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7402703f-a7dd-4f54-9f76-89a63bcc80a4', 'volume_name': 'volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af7ea39-2014-4b3f-b5e0-29b90e47fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af7ea39-2014-4b3f-b5e0-29b90e47fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9676ae1f-26f4-48c6-ba0c-c983fbdf72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:51 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Volume 7402703f-a7dd-4f54-9f76-89a63bcc80a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4', 'volume_size': 1} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-c4e062a2-4a4a-4826-9de6-1483781ee363-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-c4e062a2-4a4a-4826-9de6-1483781ee363-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8635b27b-8fd6-4f78-98c6-418366716f6d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:51 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 Jun 15 07:31:51 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:51 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 1073741824" returned: 0 in 0.840s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:51 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 Jun 15 07:31:51 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:52 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363" returned: 0 in 0.806s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:52 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363 Jun 15 07:31:52 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:52 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204" returned: 0 in 0.713s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1165985422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7402703f-a7dd-4f54-9f76-89a63bcc80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071f6741304748488149d83aa4b3fb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:31:51Z,use_quota=True,user_id='3716f47183814b55bd09a74ef98a16de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Creating volume 7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:31:52 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:52 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 1073741824 Jun 15 07:31:52 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664e75b3-bdec-4a38-9e90-fb85c6311b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc75714-d760-48d2-9fe6-84a186f2d204', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fb4076-bc95-4779-b2b7-e93a6ea3d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:52 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Volume volume-5bc75714-d760-48d2-9fe6-84a186f2d204 (5bc75714-d760-48d2-9fe6-84a186f2d204): created successfully Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fb4076-bc95-4779-b2b7-e93a6ea3d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Flow 'volume_create_manager' (acc6e193-39f9-4e3a-9443-48d532034d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:52 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-48107be1-6d48-46fe-ad58-38d64f08f589 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created volume successfully. Jun 15 07:31:52 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c4e062a2-4a4a-4826-9de6-1483781ee363" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-quobyte-c4e062a2-4a4a-4826-9de6-1483781ee363" released by "delete_volume" :: held 1.465s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:52 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Created reservations ['e748b291-29e7-40b3-86e9-27f94098cef0', '2fd3fc27-ad1e-4dca-ad99-3a0c57765f8c', '7c8ea91a-eefb-439f-bb8f-396254882cc2', 'ab364017-99c8-4a21-a55a-2debc286ed9f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:53 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:53 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:53 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 1073741824" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:53 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 Jun 15 07:31:53 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:53 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-5bc75714-d760-48d2-9fe6-84a186f2d204-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.655s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Deleted volume successfully. Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-5bc75714-d760-48d2-9fe6-84a186f2d204-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-52061b20-d6f8-4069-bba5-afe24e7d219d tempest-VolumesDeleteCascade-955253956 None] Lock "cinder-c4e062a2-4a4a-4826-9de6-1483781ee363-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-5bc75714-d760-48d2-9fe6-84a186f2d204" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-5bc75714-d760-48d2-9fe6-84a186f2d204" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed733b2-ecf1-4a24-89c3-55cff293703c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:53 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 Jun 15 07:31:53 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:54 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4" returned: 0 in 0.719s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9676ae1f-26f4-48c6-ba0c-c983fbdf72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e3292d-5f48-43d9-9e37-6ca9585a32b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:54 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Volume volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 (7402703f-a7dd-4f54-9f76-89a63bcc80a4): created successfully Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e3292d-5f48-43d9-9e37-6ca9585a32b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Flow 'volume_create_manager' (7eb3938c-679e-4685-b721-93d069b79796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:54 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0d0ac8a0-49c1-456c-9773-78319c8a0105 tempest-SnapshotMetadataTestJSON-1388185863 None] Created volume successfully. Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-35fa0124-1656-4a9d-ba61-151cf262ce17-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-35fa0124-1656-4a9d-ba61-151cf262ce17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "cinder-quobyte-35fa0124-1656-4a9d-ba61-151cf262ce17" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-35fa0124-1656-4a9d-ba61-151cf262ce17" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e3effc-c4c3-4fce-b21e-4c236e435a1b]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:54 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:31:54 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:54 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204" returned: 0 in 1.008s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:54 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204 Jun 15 07:31:54 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Creating offline snapshot 299d380a-d5f7-43ad-8066-ac2f4040e495 of volume 7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b565a5e-c84a-4b42-95f8-7ca86ecdc1b6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:55 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 Jun 15 07:31:55 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:55 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 0.857s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:55 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-5bc75714-d760-48d2-9fe6-84a186f2d204" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-5bc75714-d760-48d2-9fe6-84a186f2d204" released by "delete_volume" :: held 1.866s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:55 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:31:55 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['ef358d9c-e744-439a-ae0f-35d9ca1c28a8', 'cd5b3d04-3012-4f3e-af8b-28ab7315a5b4', '82513333-0060-422c-8394-53ce71ca503e', '5a7d62aa-4582-47a5-983a-4f1f45e5cda7'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:55 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:55 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:55 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4" returned: 0 in 0.934s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:55 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 1G Jun 15 07:31:55 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-50260acd-357d-4789-9091-74aed5c08f9b-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-50260acd-357d-4789-9091-74aed5c08f9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-50260acd-357d-4789-9091-74aed5c08f9b" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-50260acd-357d-4789-9091-74aed5c08f9b" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[255ae092-cab0-4b15-b02d-8fe790b1a353]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:56 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b Jun 15 07:31:56 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:56 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 1 in 1.056s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:56 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17 Jun 15 07:31:56 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:56 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 1G" returned: 0 in 1.063s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:57 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.205s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:57 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 Jun 15 07:31:57 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-49c764a0-cdd1-49f9-9368-a4b11c1a7eb0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-5bc75714-d760-48d2-9fe6-84a186f2d204-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:57 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b" returned: 0 in 0.952s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:57 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b Jun 15 07:31:57 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:57 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fa0124-1656-4a9d-ba61-151cf262ce17" returned: 0 in 0.842s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-quobyte-35fa0124-1656-4a9d-ba61-151cf262ce17" released by "delete_volume" :: held 2.841s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:57 devstack cinder-volume[91865]: WARNING cinder.quota [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915966363-1728629812 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915966363-1728629812, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:57 devstack cinder-volume[91865]: WARNING cinder.quota [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915966363-1728629812 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1915966363-1728629812, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=140,cinder:UPDATE=163,cinder:DELETE=14,cinder:INSERT=35 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Created reservations ['858b4569-ae10-4e19-9c8d-63c4eea5c340', '5adaecf0-3ee6-4b5f-a84f-ed21cdc55d9b', '6e0ef7ef-2e48-4049-9974-ca9b3c660c1e', '820c5ff5-6d24-4097-9e36-8eb53abdaba6'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=143,cinder:INSERT=41,cinder:SELECT=124,cinder:DELETE=14 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:57 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:57 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:57 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:57 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 is being set with open permissions: ugo+rw Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:57 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 Jun 15 07:31:57 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:57 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-50260acd-357d-4789-9091-74aed5c08f9b" returned: 0 in 0.767s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-50260acd-357d-4789-9091-74aed5c08f9b" released by "delete_volume" :: held 1.779s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:57 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['ed237939-849f-4a2b-ba07-b514265f0fdc', '861ba292-ae17-46b9-b11b-060797ba9a44', 'acaffded-3896-4a32-bab7-3447413fc817', '4e9559a2-1c24-4862-98db-8aa2e0274772'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:58 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:31:58 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-93cc833e-83cc-454c-9116-7ee7e11b7e72-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-93cc833e-83cc-454c-9116-7ee7e11b7e72-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-93cc833e-83cc-454c-9116-7ee7e11b7e72" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-93cc833e-83cc-454c-9116-7ee7e11b7e72" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:31:58 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495" returned: 0 in 0.798s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b095bf-2994-459e-9f5a-92bb063777fc]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:58 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.987s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Deleted volume successfully. Jun 15 07:31:58 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info Jun 15 07:31:58 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ad14714-906a-4c75-9f15-0edc861216a6 tempest-TestInstancesWithCinderVolumes-382288086 None] Lock "cinder-35fa0124-1656-4a9d-ba61-151cf262ce17-delete_volume" released by "delete_volume" :: held 4.198s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:58 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 Jun 15 07:31:58 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:59 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.011s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:31:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-01929c1e-3738-4770-ac00-05c2f746b9c3 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-50260acd-357d-4789-9091-74aed5c08f9b-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:31:59 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72" returned: 0 in 0.889s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:59 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72 Jun 15 07:31:59 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:59 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info" returned: 0 in 0.983s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:31:59 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info is being set with open permissions: ugo+rw Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:31:59 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info Jun 15 07:31:59 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Flow 'volume_create_manager' (37c45647-3910-4604-ba6b-5a6f0779577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae3f8a-9d8f-45f3-99cf-71d96ad4e916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ae3f8a-9d8f-45f3-99cf-71d96ad4e916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-619226384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40077ca7-0bf9-4e66-a16a-766e27814005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f7a4fed8224d3b86ccdd4665621cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:00Z,use_quota=True,user_id='e203f2c3b4dc4e65bcca6c8270ad9e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74771092-fb45-4248-9091-52f86e059d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74771092-fb45-4248-9091-52f86e059d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c418c2-7062-41b6-87ca-00e5e528e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c418c2-7062-41b6-87ca-00e5e528e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40077ca7-0bf9-4e66-a16a-766e27814005', 'volume_name': 'volume-40077ca7-0bf9-4e66-a16a-766e27814005', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82ae24a-402f-4f2a-9987-dba7983ece72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82ae24a-402f-4f2a-9987-dba7983ece72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6169848-3f79-4d2c-85c9-e0b7238f88b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:31:59 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Volume 40077ca7-0bf9-4e66-a16a-766e27814005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40077ca7-0bf9-4e66-a16a-766e27814005', 'volume_size': 1} Jun 15 07:31:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:00 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-93cc833e-83cc-454c-9116-7ee7e11b7e72" returned: 0 in 0.727s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-93cc833e-83cc-454c-9116-7ee7e11b7e72" released by "delete_volume" :: held 1.690s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['6ac28589-9b04-43a3-b654-767a5a92c7bf', 'd2e3428a-f8dd-48af-a33c-a37a8118c39d', '7029d087-d1c7-4451-b2a3-9ee202da313a', '69b213fb-89c0-4c8c-b0f2-62863ab3dcd5'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:00 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.info" returned: 0 in 0.723s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:00 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:00 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.453s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.495s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-619226384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40077ca7-0bf9-4e66-a16a-766e27814005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f7a4fed8224d3b86ccdd4665621cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:00Z,use_quota=True,user_id='e203f2c3b4dc4e65bcca6c8270ad9e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Creating volume 40077ca7-0bf9-4e66-a16a-766e27814005 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:00 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:00 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 1073741824 Jun 15 07:32:00 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:00 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-154058bc-328e-4ba1-a3f9-517a9a524332 tempest-SnapshotMetadataTestJSON-1388185863 None] Create snapshot completed successfully Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-8749f612-ee13-4827-8ada-25bb042897fd-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-8749f612-ee13-4827-8ada-25bb042897fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-8749f612-ee13-4827-8ada-25bb042897fd" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-8749f612-ee13-4827-8ada-25bb042897fd" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd686e5-35cc-463a-bd6a-413b3114f790]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:00 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd Jun 15 07:32:00 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:01 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.872s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-589fb47b-a56d-4a2b-8018-b09e9fef50f0 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-93cc833e-83cc-454c-9116-7ee7e11b7e72-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:01 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 1073741824" returned: 0 in 1.177s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:01 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 Jun 15 07:32:01 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:01 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd" returned: 0 in 1.047s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:01 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd Jun 15 07:32:01 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "cinder-299d380a-d5f7-43ad-8066-ac2f4040e495-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-299d380a-d5f7-43ad-8066-ac2f4040e495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "cinder-quobyte-299d380a-d5f7-43ad-8066-ac2f4040e495" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-299d380a-d5f7-43ad-8066-ac2f4040e495" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Deleting offline snapshot 299d380a-d5f7-43ad-8066-ac2f4040e495 of volume 7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] snapshot_file for this snap is: volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4827a58-2ce8-4d93-9151-e5146cbb8862]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:02 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005" returned: 0 in 0.746s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6169848-3f79-4d2c-85c9-e0b7238f88b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40077ca7-0bf9-4e66-a16a-766e27814005', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bb25e9-c068-4097-b46c-4bbe4b786ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Volume volume-40077ca7-0bf9-4e66-a16a-766e27814005 (40077ca7-0bf9-4e66-a16a-766e27814005): created successfully Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bb25e9-c068-4097-b46c-4bbe4b786ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Flow 'volume_create_manager' (37c45647-3910-4604-ba6b-5a6f0779577c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a9a17703-6a7d-4b48-abc0-cb8c897d2544 tempest-VolumesTransfersV355Test-176779255 None] Created volume successfully. Jun 15 07:32:02 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 Jun 15 07:32:02 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:02 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8749f612-ee13-4827-8ada-25bb042897fd" returned: 0 in 0.696s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-8749f612-ee13-4827-8ada-25bb042897fd" released by "delete_volume" :: held 1.798s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['835fdb36-956b-4ffc-b676-2e7428c72ec5', '49c1a239-67f8-43b2-b023-f3a1e0d8940c', 'a3ff719b-4bce-4ca0-8c56-fb279d773a83', '88359ee6-be77-4eaf-b997-fc1bad77798a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:02 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:02 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-b7454c4e-bf8e-4974-a853-ba81df8c44a6-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-b7454c4e-bf8e-4974-a853-ba81df8c44a6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-b7454c4e-bf8e-4974-a853-ba81df8c44a6" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-b7454c4e-bf8e-4974-a853-ba81df8c44a6" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b80d82-bf5c-4176-b8c8-06fbd615ee13]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:03 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495" returned: 0 in 1.017s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:32:03 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 Jun 15 07:32:03 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c8519-d210-41ee-a434-862eb901e010]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:03 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 Jun 15 07:32:03 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:03 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.979s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:32:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0cc1d854-a933-434b-a7a0-e97e2eeb8305 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-8749f612-ee13-4827-8ada-25bb042897fd-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:04 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e199328a-be5c-49a4-b22e-875f7ba36b41 tempest-VolumesTransfersV355Test-105568328 None] Transfer volume completed successfully. Jun 15 07:32:04 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6" returned: 0 in 1.005s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:04 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6 Jun 15 07:32:04 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:04 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4" returned: 0 in 1.028s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:04 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 Jun 15 07:32:04 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:04 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7454c4e-bf8e-4974-a853-ba81df8c44a6" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-b7454c4e-bf8e-4974-a853-ba81df8c44a6" released by "delete_volume" :: held 1.823s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "cinder-40077ca7-0bf9-4e66-a16a-766e27814005-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['ea37c2d3-99b0-4085-939c-077f8c24494c', '12a5d57e-a537-48e8-b1c3-3c20362fdff3', 'ddfee3bd-f388-4283-9ceb-072bf1bf130b', '273a152f-aea1-4294-b931-6388848171c9'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-40077ca7-0bf9-4e66-a16a-766e27814005-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "cinder-quobyte-40077ca7-0bf9-4e66-a16a-766e27814005" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-quobyte-40077ca7-0bf9-4e66-a16a-766e27814005" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[486b18c3-2144-4ac5-a0d7-e73628d0bcc5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:05 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495" returned: 0 in 0.865s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:05 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:05 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:05 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495 Jun 15 07:32:05 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:05 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 Jun 15 07:32:05 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-445ac785-264b-40b6-8f28-f7c65296ba03-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-445ac785-264b-40b6-8f28-f7c65296ba03-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "cinder-quobyte-445ac785-264b-40b6-8f28-f7c65296ba03" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-445ac785-264b-40b6-8f28-f7c65296ba03" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b647bdc0-5103-4df6-8245-b09906761810]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:05 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 Jun 15 07:32:05 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:06 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4.299d380a-d5f7-43ad-8066-ac2f4040e495" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:06 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.880s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-299d380a-d5f7-43ad-8066-ac2f4040e495" released by "_delete_snapshot" :: held 3.893s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" released by "delete_snapshot" :: held 3.943s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-990f36e8-7b61-4554-8aa9-f86fb61b4afe tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-b7454c4e-bf8e-4974-a853-ba81df8c44a6-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:06 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005" returned: 0 in 1.083s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Created reservations ['3663a490-2aa0-4aa2-bdd8-0d067e2dbd37', '82c20d48-5db5-48f9-a8cf-f34cf655eab7', '3d18d1e4-ecaa-43b5-a8bd-54cd49d1ed80', '9d619f63-4bb8-4751-b562-9ba97fe95dfe'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:06 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005 Jun 15 07:32:06 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Delete snapshot completed successfully. Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-628616a0-8ec9-4033-9a9e-e57ff55c20d9 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-299d380a-d5f7-43ad-8066-ac2f4040e495-delete_snapshot" released by "delete_snapshot" :: held 4.202s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "cinder-7402703f-a7dd-4f54-9f76-89a63bcc80a4-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-7402703f-a7dd-4f54-9f76-89a63bcc80a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:06 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03" returned: 0 in 1.071s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:06 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03 Jun 15 07:32:06 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52a9c8-4666-453c-8d82-d2aa350584d7]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:06 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 Jun 15 07:32:06 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:07 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-40077ca7-0bf9-4e66-a16a-766e27814005" returned: 0 in 0.749s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-quobyte-40077ca7-0bf9-4e66-a16a-766e27814005" released by "delete_volume" :: held 1.887s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Created reservations ['b609cca9-861e-44b8-b590-9c67e242aa38', 'b94e69e5-4639-40d2-bda3-27a5f0c68ad1', '27635d2d-4973-4acd-bcf4-88c288627ba4', '4fdd1c0a-0941-45f1-8132-8a479032eeb5'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:07 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:07 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:07 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-445ac785-264b-40b6-8f28-f7c65296ba03" returned: 0 in 0.747s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-quobyte-445ac785-264b-40b6-8f28-f7c65296ba03" released by "delete_volume" :: held 1.898s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Created reservations ['74aab26f-9b8c-422a-a337-6a89e7fe9590', 'ec57ac74-b95e-4c2e-8d28-5d22dd003f59', 'd1a923df-8560-47f0-9051-722280e02180', 'aff5f704-6423-4288-8b83-9a9a464fc9ce'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:07 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:07 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:07 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4" returned: 0 in 0.947s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:07 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4 Jun 15 07:32:07 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Flow 'volume_create_manager' (37a22763-266f-472c-9b8e-9b647990056a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6a4ba6-9dcf-45d9-8b8e-984a4494e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6a4ba6-9dcf-45d9-8b8e-984a4494e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2096437410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a19f62-5ff5-47b6-8761-011eeb0fc0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f7a4fed8224d3b86ccdd4665621cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:08Z,use_quota=True,user_id='e203f2c3b4dc4e65bcca6c8270ad9e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da1967-4842-4b03-b63d-2baff63a1a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da1967-4842-4b03-b63d-2baff63a1a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905299c6-2af9-42eb-bf4d-791010e5d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (905299c6-2af9-42eb-bf4d-791010e5d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a19f62-5ff5-47b6-8761-011eeb0fc0dd', 'volume_name': 'volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:08 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da02f872-5b75-412d-ae21-f1e9b5e46106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da02f872-5b75-412d-ae21-f1e9b5e46106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84511cc0-b74e-4910-9a71-0f8050ec1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Volume 60a19f62-5ff5-47b6-8761-011eeb0fc0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd', 'volume_size': 1} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2096437410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a19f62-5ff5-47b6-8761-011eeb0fc0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f7a4fed8224d3b86ccdd4665621cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:08Z,use_quota=True,user_id='e203f2c3b4dc4e65bcca6c8270ad9e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Creating volume 60a19f62-5ff5-47b6-8761-011eeb0fc0dd {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:08 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.272s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Deleted volume successfully. Jun 15 07:32:08 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd 1073741824 Jun 15 07:32:08 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-420f0fb8-2cee-40e9-83bb-8da12098baad tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-40077ca7-0bf9-4e66-a16a-766e27814005-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:08 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7402703f-a7dd-4f54-9f76-89a63bcc80a4" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-quobyte-7402703f-a7dd-4f54-9f76-89a63bcc80a4" released by "delete_volume" :: held 1.910s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:08 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.095s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Deleted volume successfully. Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Created reservations ['83b74e01-31e5-408a-b14d-b0c13b8ee571', '660be608-1eb0-4c5f-bc07-9f901953c13c', 'c6ca1d3c-ece4-49fa-8706-dc229e1f353c', '2ad0d2bb-9b9b-402c-a8e4-91881395117e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d95453f2-02e2-4565-9a9f-8e33ff005246 tempest-CreateVolumesFromSourceVolumeTest-1456771528 None] Lock "cinder-445ac785-264b-40b6-8f28-f7c65296ba03-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:08 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:08 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:09 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd 1073741824" returned: 0 in 1.214s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:09 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.819s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:09 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Deleted volume successfully. Jun 15 07:32:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0826aa15-6be4-44b7-9b70-b1cda26c0155 tempest-SnapshotMetadataTestJSON-1388185863 None] Lock "cinder-7402703f-a7dd-4f54-9f76-89a63bcc80a4-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:09 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd Jun 15 07:32:09 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:10 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" returned: 0 in 0.770s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84511cc0-b74e-4910-9a71-0f8050ec1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879d4f23-b479-419a-b959-557ef23e9903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:10 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Volume volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd (60a19f62-5ff5-47b6-8761-011eeb0fc0dd): created successfully Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879d4f23-b479-419a-b959-557ef23e9903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Flow 'volume_create_manager' (37a22763-266f-472c-9b8e-9b647990056a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e39afd12-acb0-4291-ac05-a07140742680 tempest-VolumesTransfersV355Test-176779255 None] Created volume successfully. Jun 15 07:32:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "cinder-60a19f62-5ff5-47b6-8761-011eeb0fc0dd-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-60a19f62-5ff5-47b6-8761-011eeb0fc0dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "cinder-quobyte-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-quobyte-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a3124-491d-4582-b42f-6e50587eb427]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:12 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd Jun 15 07:32:12 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:12 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" returned: 0 in 0.755s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:12 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd Jun 15 07:32:12 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Flow 'volume_create_manager' (3d53f688-69e7-453c-900c-9cd34ebdae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8eccd1-d1de-4c19-8821-bc02c8813753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8eccd1-d1de-4c19-8821-bc02c8813753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-946369388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532dd765-cc37-4248-8822-9803c8d58e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11a5716ac084b63bebb1cab104e1907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:13Z,use_quota=True,user_id='c69470d540a448fca5ebccc369fcf4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991ada2b-7bf2-4a1e-b143-302556fc0ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991ada2b-7bf2-4a1e-b143-302556fc0ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b535b9d2-ba08-471a-8a3a-5af9ec440bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b535b9d2-ba08-471a-8a3a-5af9ec440bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532dd765-cc37-4248-8822-9803c8d58e6a', 'volume_name': 'volume-532dd765-cc37-4248-8822-9803c8d58e6a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06c68e6-c05f-4e0f-a8b2-c2ccac38bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06c68e6-c05f-4e0f-a8b2-c2ccac38bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4affb68f-1bc8-4efa-9d59-23c46593f36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Volume 532dd765-cc37-4248-8822-9803c8d58e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532dd765-cc37-4248-8822-9803c8d58e6a', 'volume_size': 1} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-946369388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532dd765-cc37-4248-8822-9803c8d58e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11a5716ac084b63bebb1cab104e1907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:13Z,use_quota=True,user_id='c69470d540a448fca5ebccc369fcf4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Creating volume 532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:12 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a 1073741824 Jun 15 07:32:12 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:13 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" returned: 0 in 0.625s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-quobyte-60a19f62-5ff5-47b6-8761-011eeb0fc0dd" released by "delete_volume" :: held 1.427s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Created reservations ['5beb677f-f0bf-45ca-8fbe-624fc8ea66d2', '1f5ed989-f0b0-4bd0-a04d-2c0d5300632c', 'c1981bab-b7eb-4a96-a39b-57a855bfb2a7', '60e191a9-3318-44d4-a6fb-a1d7e3bc4e87'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:13 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:13 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:13 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a 1073741824" returned: 0 in 0.867s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:13 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:13 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:14 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.735s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Deleted volume successfully. Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-64ede2d2-319f-4d7c-8743-e1de0ada8c97 tempest-VolumesTransfersV355Test-604207068 None] Lock "cinder-60a19f62-5ff5-47b6-8761-011eeb0fc0dd-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:14 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4affb68f-1bc8-4efa-9d59-23c46593f36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532dd765-cc37-4248-8822-9803c8d58e6a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da6819a-cb49-4e22-b621-8b4b394bc01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:14 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Volume volume-532dd765-cc37-4248-8822-9803c8d58e6a (532dd765-cc37-4248-8822-9803c8d58e6a): created successfully Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da6819a-cb49-4e22-b621-8b4b394bc01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Flow 'volume_create_manager' (3d53f688-69e7-453c-900c-9cd34ebdae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1c763b6a-77d0-4b69-9328-56def06b146c tempest-VolumesCloneTest-2131110055 None] Created volume successfully. Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Flow 'volume_create_manager' (dad35792-c036-472d-b795-52555eaec168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d46fcc-3d0f-4e94-9795-5aaccb68c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d46fcc-3d0f-4e94-9795-5aaccb68c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1499174196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d690e23-8490-4e85-912a-523cd386910d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11a5716ac084b63bebb1cab104e1907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=532dd765-cc37-4248-8822-9803c8d58e6a,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:15Z,use_quota=True,user_id='c69470d540a448fca5ebccc369fcf4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b106a4ce-d213-435a-84ce-1babd57b29f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b106a4ce-d213-435a-84ce-1babd57b29f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae4b337-30ec-41e8-850a-2ad225291bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae4b337-30ec-41e8-850a-2ad225291bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0d690e23-8490-4e85-912a-523cd386910d', 'volume_name': 'volume-0d690e23-8490-4e85-912a-523cd386910d', 'volume_size': 2, 'source_volid': '532dd765-cc37-4248-8822-9803c8d58e6a', 'source_volstatus': 'available'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b875acd1-d578-4388-997d-766c1df8751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b875acd1-d578-4388-997d-766c1df8751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2538b2e8-18fa-4984-b06f-4181c344efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Volume 0d690e23-8490-4e85-912a-523cd386910d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0d690e23-8490-4e85-912a-523cd386910d', 'volume_size': 2, 'source_volid': '532dd765-cc37-4248-8822-9803c8d58e6a', 'source_volstatus': 'available'} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:15 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Cloning volume 532dd765-cc37-4248-8822-9803c8d58e6a to volume 0d690e23-8490-4e85-912a-523cd386910d Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Creating offline snapshot 04c383c2-ce7e-40b4-a5ec-5f6642392f42 of volume 532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb35e3c-97f3-4b9a-bdb8-3f5cb672316f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:15 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:15 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:16 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.825s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:16 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 1G Jun 15 07:32:16 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:17 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 1G" returned: 0 in 0.915s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532dd765-cc37-4248-8822-9803c8d58e6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:17 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532dd765-cc37-4248-8822-9803c8d58e6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:17 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:18 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-532dd765-cc37-4248-8822-9803c8d58e6a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:18 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 is being set with open permissions: ugo+rw Jun 15 07:32:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:18 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:18 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:19 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:19 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info Jun 15 07:32:19 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:19 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info" returned: 0 in 0.755s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:19 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info is being set with open permissions: ugo+rw Jun 15 07:32:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:19 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info Jun 15 07:32:19 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:20 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.info" returned: 0 in 0.764s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] snapshot: 04c383c2-ce7e-40b4-a5ec-5f6642392f42, volume: 0d690e23-8490-4e85-912a-523cd386910d, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be9d46-6215-4e73-8882-7d1c0b78971f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:20 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:20 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Flow 'volume_create_manager' (1fd0ebee-f399-415c-ae49-849092997e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4620a-24ad-4efb-b558-c811099ab215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec4620a-24ad-4efb-b558-c811099ab215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157813390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dd59b4-3b1d-403c-ab27-9f6eee8a08ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4462e9ba95ed4e72aa4b26df4779ff7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:21Z,use_quota=True,user_id='b21a43720f564674ae1037b4f870c540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9113bccc-6378-435a-b992-37b1dfede5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9113bccc-6378-435a-b992-37b1dfede5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b4efc-e77f-4dd5-8392-f3bac93f26e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:32:21 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.907s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532dd765-cc37-4248-8822-9803c8d58e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17b4efc-e77f-4dd5-8392-f3bac93f26e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20dd59b4-3b1d-403c-ab27-9f6eee8a08ae', 'volume_name': 'volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036f3d4f-730b-41e4-9722-c00bc78b8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036f3d4f-730b-41e4-9722-c00bc78b8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9839d9-c332-4cea-bfc8-52bec63b2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:21 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Trying to clone 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c at location (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e85e2e6-e560-4867-b558-0bd8d185e475]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:21 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:21 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:21 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:32:21 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2769bd-0a77-4cb8-8cae-bb31bb13bfa9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:22 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD Jun 15 07:32:22 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:22 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.849s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:22 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d Jun 15 07:32:22 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:22 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c is fetched for user b21a43720f564674ae1037b4f870c540. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8d2639-68cd-437e-8966-752af47de94c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:23 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD Jun 15 07:32:23 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:23 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:28 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d" returned: 0 in 5.582s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a627f5b-268d-44db-a946-c4f67556b34a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:28 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:28 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:28 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.897s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:32:28 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Converted 1024.00 MB image at 183.41 MB/s Jun 15 07:32:28 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d is being set with open permissions: ugo+rw Jun 15 07:32:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:28 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d Jun 15 07:32:28 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:29 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d" returned: 0 in 0.608s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" released by "_copy_volume_from_snapshot" :: held 8.968s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-quobyte-04c383c2-ce7e-40b4-a5ec-5f6642392f42" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-04c383c2-ce7e-40b4-a5ec-5f6642392f42" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Deleting offline snapshot 04c383c2-ce7e-40b4-a5ec-5f6642392f42 of volume 532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] snapshot_file for this snap is: volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f440b9-d777-4694-bf3d-9f01a3d71c03]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:29 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:29 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:30 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.730s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-532dd765-cc37-4248-8822-9803c8d58e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:32:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2b709e-9d78-499a-af44-dd737bd350c6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:30 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:30 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:31 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:31 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:31 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:31 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.808s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:31 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42 Jun 15 07:32:31 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:32 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a.04c383c2-ce7e-40b4-a5ec-5f6642392f42" returned: 0 in 0.599s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-04c383c2-ce7e-40b4-a5ec-5f6642392f42" released by "_delete_snapshot" :: held 2.967s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.924s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.630s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1157813390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20dd59b4-3b1d-403c-ab27-9f6eee8a08ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4462e9ba95ed4e72aa4b26df4779ff7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:21Z,use_quota=True,user_id='b21a43720f564674ae1037b4f870c540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Creating volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:32 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:32 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1073741824 Jun 15 07:32:32 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2538b2e8-18fa-4984-b06f-4181c344efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d690e23-8490-4e85-912a-523cd386910d', 'volume_size': 2, 'source_volid': '532dd765-cc37-4248-8822-9803c8d58e6a', 'source_volstatus': 'available'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a10d8f-36d3-4c2d-9ea7-8448e1ad6d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Volume volume-0d690e23-8490-4e85-912a-523cd386910d (0d690e23-8490-4e85-912a-523cd386910d): created successfully Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a10d8f-36d3-4c2d-9ea7-8448e1ad6d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Flow 'volume_create_manager' (dad35792-c036-472d-b795-52555eaec168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8d817d83-6c21-4c94-9665-564a512e56f3 tempest-VolumesCloneTest-2131110055 None] Created volume successfully. Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-0d690e23-8490-4e85-912a-523cd386910d-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-0d690e23-8490-4e85-912a-523cd386910d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a45c4-cb79-4ef3-acd0-39e5a09fc678]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:33 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d Jun 15 07:32:33 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:33 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1073741824" returned: 0 in 0.902s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:33 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:33 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:34 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d" returned: 0 in 0.821s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:34 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d Jun 15 07:32:34 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:34 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 0.717s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Attempting download of 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f0987-1ab5-4c62-8fcf-ffd771716cbd]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:34 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50 Jun 15 07:32:34 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:34 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d690e23-8490-4e85-912a-523cd386910d" returned: 0 in 0.657s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-0d690e23-8490-4e85-912a-523cd386910d" released by "delete_volume" :: held 1.528s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:34 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Created reservations ['b26b8709-e997-4a2c-94d1-034fcbe82ee5', '1d44e27c-c982-4fc0-9b9d-6f41eb993df8', '97184ab8-ef6f-426d-8deb-a1d9a8808427', '3104a2c3-c0b4-479c-8fab-371badb67b19'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:35 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:35 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:35 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:35 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50 Jun 15 07:32:35 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-532dd765-cc37-4248-8822-9803c8d58e6a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-532dd765-cc37-4248-8822-9803c8d58e6a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:35 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.711s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "cinder-quobyte-532dd765-cc37-4248-8822-9803c8d58e6a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Deleted volume successfully. Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-331c8690-e639-450c-913d-4b4ee19ae249 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-0d690e23-8490-4e85-912a-523cd386910d-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-532dd765-cc37-4248-8822-9803c8d58e6a" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b16f44-b7e7-49ff-bb10-9a96c3edb10e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:35 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:35 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:36 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50" returned: 1 in 0.917s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_50bk5u50' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadabd7a-cd5e-4d9f-a508-8ccd6dd0bdf5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:36 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD Jun 15 07:32:36 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:36 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.955s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:36 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a Jun 15 07:32:36 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:36 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c was qcow2, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:32:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:36 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:36 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:37 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-532dd765-cc37-4248-8822-9803c8d58e6a" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-quobyte-532dd765-cc37-4248-8822-9803c8d58e6a" released by "delete_volume" :: held 1.683s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Created reservations ['342e7521-b5d7-46b0-90c9-ef43780b2b41', 'fce71db4-c3d6-4259-879c-e59c3e25d42b', 'dc78c4e9-f8a1-4d38-8b55-a99260065d96', '86f8ad57-7ac3-4cc0-9894-5cb0408fd101'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:37 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:37 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:38 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:38 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Deleted volume successfully. Jun 15 07:32:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4c4a8647-d816-4ebd-a04f-c96ac8d51845 tempest-VolumesCloneTest-2131110055 None] Lock "cinder-532dd765-cc37-4248-8822-9803c8d58e6a-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:39 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 2.269s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_0iabhz8fdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:32:39 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Converted 112.00 MB image at 49.33 MB/s Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:39 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1G Jun 15 07:32:39 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:39 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 1G" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe586a5-2822-4383-9e0b-6182503de150]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:40 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:40 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:40 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 0.791s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:40 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:40 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (3db6d801-6876-4d72-b3f2-aa622d393364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb8896-df9a-494f-acba-6f6eef5c12bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb8896-df9a-494f-acba-6f6eef5c12bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2027995995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0878f2ab-9ec7-4003-a635-77249dd38169,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:41Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f33f3-1be2-4099-af67-92dc1858cd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58f33f3-1be2-4099-af67-92dc1858cd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d226580-19d1-4f31-827c-4cf73deaf1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d226580-19d1-4f31-827c-4cf73deaf1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0878f2ab-9ec7-4003-a635-77249dd38169', 'volume_name': 'volume-0878f2ab-9ec7-4003-a635-77249dd38169', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2904994c-e5b2-4fe3-bf1b-c5f87ceaa9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2904994c-e5b2-4fe3-bf1b-c5f87ceaa9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b56df4-1b9b-47a5-a30f-c3e1a38b707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Volume 0878f2ab-9ec7-4003-a635-77249dd38169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0878f2ab-9ec7-4003-a635-77249dd38169', 'volume_size': 1} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2027995995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0878f2ab-9ec7-4003-a635-77249dd38169,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:41Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Creating volume 0878f2ab-9ec7-4003-a635-77249dd38169 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:41 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:41 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 1073741824 Jun 15 07:32:41 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:41 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 1 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Downloaded image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c for user b21a43720f564674ae1037b4f870c540 is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Marking volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Copying metadata from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c to 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Creating volume glance metadata for volume 20dd59b4-3b1d-403c-ab27-9f6eee8a08ae backed by image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9839d9-c332-4cea-bfc8-52bec63b2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6043b8c-7955-424c-9634-923feb986d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:41 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Volume volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae (20dd59b4-3b1d-403c-ab27-9f6eee8a08ae): created successfully Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6043b8c-7955-424c-9634-923feb986d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Flow 'volume_create_manager' (1fd0ebee-f399-415c-ae49-849092997e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4a761c90-0993-4acb-8748-2155084fade0 tempest-VolumesExtendTest-94042659 None] Created volume successfully. Jun 15 07:32:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:42 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 1073741824" returned: 0 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:42 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 Jun 15 07:32:42 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:42 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169" returned: 0 in 0.582s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.963s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b56df4-1b9b-47a5-a30f-c3e1a38b707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0878f2ab-9ec7-4003-a635-77249dd38169', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51cebe4-1ba2-49d4-917a-8419f147188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f030c7e1-7847-4765-b96a-5eee0e3cba8c]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:42 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Volume volume-0878f2ab-9ec7-4003-a635-77249dd38169 (0878f2ab-9ec7-4003-a635-77249dd38169): created successfully Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c51cebe4-1ba2-49d4-917a-8419f147188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:42 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (3db6d801-6876-4d72-b3f2-aa622d393364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e127d930-39db-4ac2-96cb-ed83bbbef3d7 tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:32:43 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:43 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:43 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 0.714s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:43 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:43 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (79655a19-b6b2-45b8-9d09-48cd70402305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c9d181-67f9-4118-a9b5-257ce0d7fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c9d181-67f9-4118-a9b5-257ce0d7fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1769124864',display_name='tempest-VolumesGetTest-Volume-663965687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c08b690-af08-47b5-a4a1-740e116286c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:44Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b54e3c-1ef3-45d6-b4a9-6400021ee644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b54e3c-1ef3-45d6-b4a9-6400021ee644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ec777-c7f4-42f1-a1b3-a461ab9ad710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ec777-c7f4-42f1-a1b3-a461ab9ad710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c08b690-af08-47b5-a4a1-740e116286c1', 'volume_name': 'volume-4c08b690-af08-47b5-a4a1-740e116286c1', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cd7ac6-efc1-496c-8aa4-b7ac15a7a3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cd7ac6-efc1-496c-8aa4-b7ac15a7a3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073ca561-114f-4144-a6f7-ff6475c0d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Volume 4c08b690-af08-47b5-a4a1-740e116286c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c08b690-af08-47b5-a4a1-740e116286c1', 'volume_size': 1} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:44 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 1 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 2G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae 2G" returned: 0 in 0.054s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.528s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1769124864',display_name='tempest-VolumesGetTest-Volume-663965687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c08b690-af08-47b5-a4a1-740e116286c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:44Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Creating volume 4c08b690-af08-47b5-a4a1-740e116286c1 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:44 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:44 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 1073741824 Jun 15 07:32:44 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-97a97047-815b-4512-bfd1-fae27a052f66 tempest-VolumesExtendTest-94042659 None] Extend volume completed successfully. Jun 15 07:32:45 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 1073741824" returned: 0 in 0.772s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:45 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 Jun 15 07:32:45 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "cinder-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-quobyte-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171a436-b962-4ef9-8f97-96cb5939c3c6]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:45 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:45 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:45 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1" returned: 0 in 0.697s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073ca561-114f-4144-a6f7-ff6475c0d02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c08b690-af08-47b5-a4a1-740e116286c1', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b42c22-1c6d-4d27-846c-739f2906c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:46 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Volume volume-4c08b690-af08-47b5-a4a1-740e116286c1 (4c08b690-af08-47b5-a4a1-740e116286c1): created successfully Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b42c22-1c6d-4d27-846c-739f2906c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (79655a19-b6b2-45b8-9d09-48cd70402305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d548efeb-003b-4f93-9de0-de6ea290ee06 tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-4c08b690-af08-47b5-a4a1-740e116286c1-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "cinder-4c08b690-af08-47b5-a4a1-740e116286c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:46 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 0.898s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-4c08b690-af08-47b5-a4a1-740e116286c1" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-4c08b690-af08-47b5-a4a1-740e116286c1" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c3d1f-e0dc-4801-b985-5c609cc41a0a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:46 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:46 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:46 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:46 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:46 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 Jun 15 07:32:46 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:47 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 1 in 0.848s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:47 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.815s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:47 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:47 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:32:47 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1" returned: 0 in 0.923s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:47 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1 Jun 15 07:32:47 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:48 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" returned: 0 in 0.763s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae" released by "delete_volume" :: held 2.588s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Created reservations ['89e62988-0424-4f7f-900d-b600219ba4fc', '8f9b5971-12b8-45ad-bec7-7a56d9688dee', '991dfcb6-dec5-4eae-8c42-886ea92ad1b6', '818b5e31-8e35-4694-b818-9ef0f0326085'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:48 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4c08b690-af08-47b5-a4a1-740e116286c1" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-4c08b690-af08-47b5-a4a1-740e116286c1" released by "delete_volume" :: held 1.667s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Created reservations ['d0e05c02-f008-44cb-86e3-e24b75b6d2e3', '106cb972-53a1-41b7-bea2-e56d215ede5b', 'b931412d-8268-4234-953a-972789778d4e', '164a4c02-9800-4968-b4b1-a90bd44b7f9d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:48 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:48 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:48 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:48 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-0878f2ab-9ec7-4003-a635-77249dd38169-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "cinder-0878f2ab-9ec7-4003-a635-77249dd38169-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-0878f2ab-9ec7-4003-a635-77249dd38169" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-0878f2ab-9ec7-4003-a635-77249dd38169" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8800597-398c-41bd-ab0f-974d0ab92fa6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:48 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.721s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:48 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Deleted volume successfully. Jun 15 07:32:49 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-004f9b01-5858-4e8c-9194-89f1f562e478 tempest-VolumesExtendTest-94042659 None] Lock "cinder-20dd59b4-3b1d-403c-ab27-9f6eee8a08ae-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07bfe2a7-14ea-4a2c-b84c-4ed119e0aece tempest-VolumesGetTest-842717435 None] Lock "cinder-4c08b690-af08-47b5-a4a1-740e116286c1-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:49 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 Jun 15 07:32:49 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Flow 'volume_create_manager' (ea183012-126c-4052-938b-3c96d99b6047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016685c1-826a-4b32-9e8c-58a8d5c1340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016685c1-826a-4b32-9e8c-58a8d5c1340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1926784404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8af7f17-6191-4de2-8251-dc05aefede7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4462e9ba95ed4e72aa4b26df4779ff7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:49Z,use_quota=True,user_id='b21a43720f564674ae1037b4f870c540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189d9686-5176-4db7-b227-6e2f9089c42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189d9686-5176-4db7-b227-6e2f9089c42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5de6d88-b89f-4de5-a96b-5ceca07e336d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5de6d88-b89f-4de5-a96b-5ceca07e336d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8af7f17-6191-4de2-8251-dc05aefede7a', 'volume_name': 'volume-c8af7f17-6191-4de2-8251-dc05aefede7a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd648af-9844-4955-9eae-6c1dd3590104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd648af-9844-4955-9eae-6c1dd3590104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caef8a1e-c2ce-4114-bc78-075ebe0be860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Volume c8af7f17-6191-4de2-8251-dc05aefede7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8af7f17-6191-4de2-8251-dc05aefede7a', 'volume_size': 1} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1926784404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8af7f17-6191-4de2-8251-dc05aefede7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4462e9ba95ed4e72aa4b26df4779ff7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:49Z,use_quota=True,user_id='b21a43720f564674ae1037b4f870c540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Creating volume c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:49 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:49 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a 1073741824 Jun 15 07:32:49 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:49 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169" returned: 0 in 0.798s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:49 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169 Jun 15 07:32:49 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:50 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a 1073741824" returned: 0 in 0.816s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:50 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:32:50 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:50 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0878f2ab-9ec7-4003-a635-77249dd38169" returned: 0 in 0.631s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-0878f2ab-9ec7-4003-a635-77249dd38169" released by "delete_volume" :: held 1.471s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Created reservations ['6920e4ec-206c-434c-a551-5ed0f991c3eb', '3c79b77e-3937-4f65-9d6c-c805f7e14206', 'ed62332d-a55d-406e-8400-37b4586c614a', '6d7af67e-620d-4110-b14c-8cfc445f5e78'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:50 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:32:50 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:50 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.635s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caef8a1e-c2ce-4114-bc78-075ebe0be860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8af7f17-6191-4de2-8251-dc05aefede7a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00688c2f-ff54-47d0-bdef-b763d2fb0d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:50 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Volume volume-c8af7f17-6191-4de2-8251-dc05aefede7a (c8af7f17-6191-4de2-8251-dc05aefede7a): created successfully Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00688c2f-ff54-47d0-bdef-b763d2fb0d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Flow 'volume_create_manager' (ea183012-126c-4052-938b-3c96d99b6047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d81aa1c9-8124-45c8-860f-6ce2cc19cf41 tempest-VolumesExtendTest-94042659 None] Created volume successfully. Jun 15 07:32:51 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.632s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:32:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a501ae3f-76c9-4143-9829-b6e97e4a8684 tempest-VolumesGetTest-842717435 None] Lock "cinder-0878f2ab-9ec7-4003-a635-77249dd38169-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (a188bac9-9d15-47e1-84f9-354a385cc822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d44d25-9c77-46d4-9a99-945b82b95f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d44d25-9c77-46d4-9a99-945b82b95f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-558989430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d861a1a-3819-48e0-bda4-7a91a90acb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:51Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f24cb-9108-4661-8f5d-6ee0b837ff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f24cb-9108-4661-8f5d-6ee0b837ff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8281c187-d149-474c-abc7-28153e6766c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8281c187-d149-474c-abc7-28153e6766c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d861a1a-3819-48e0-bda4-7a91a90acb07', 'volume_name': 'volume-0d861a1a-3819-48e0-bda4-7a91a90acb07', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61587b0e-eb1f-459f-b853-2360e8e9cb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61587b0e-eb1f-459f-b853-2360e8e9cb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cb8ddf-3cce-4e1c-aeae-33b0cc51ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:51 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Volume 0d861a1a-3819-48e0-bda4-7a91a90acb07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d861a1a-3819-48e0-bda4-7a91a90acb07', 'volume_size': 1} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-558989430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d861a1a-3819-48e0-bda4-7a91a90acb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:51Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Creating volume 0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:32:51 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:51 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 1073741824 Jun 15 07:32:51 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:52 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 1073741824" returned: 0 in 0.800s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:52 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:32:52 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:53 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.772s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.577s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Creating offline snapshot 3361e40c-8338-47de-8646-de9e167958ce of volume c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cb8ddf-3cce-4e1c-aeae-33b0cc51ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d861a1a-3819-48e0-bda4-7a91a90acb07', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26102699-8923-4f55-9d5c-200ea240a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e6214-8b18-4914-bf83-cf32dea9eeda]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:53 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Volume volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 (0d861a1a-3819-48e0-bda4-7a91a90acb07): created successfully Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26102699-8923-4f55-9d5c-200ea240a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (a188bac9-9d15-47e1-84f9-354a385cc822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-282b1bd0-6378-4d78-8f78-c66ce3c58aff tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:32:53 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:32:53 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:54 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.980s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:54 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce 1G Jun 15 07:32:54 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (7fc260b8-4925-4f39-a1d4-36a411530883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8c0ef0-7bf3-449c-a41c-205c9d7ecadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8c0ef0-7bf3-449c-a41c-205c9d7ecadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1280958542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fc701c-4d6f-48ba-829b-833fe28b57c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0d861a1a-3819-48e0-bda4-7a91a90acb07,status='creating',terminated_at=None,updated_at=2026-06-15T05:32:54Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58117b44-25ee-4112-944e-5fe9f6a61549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58117b44-25ee-4112-944e-5fe9f6a61549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c05a08-318b-480b-a94b-da506e6b929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c05a08-318b-480b-a94b-da506e6b929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '35fc701c-4d6f-48ba-829b-833fe28b57c6', 'volume_name': 'volume-35fc701c-4d6f-48ba-829b-833fe28b57c6', 'volume_size': 1, 'source_volid': '0d861a1a-3819-48e0-bda4-7a91a90acb07', 'source_volstatus': 'available'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3795a087-d70d-432f-9137-d5183c6769cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3795a087-d70d-432f-9137-d5183c6769cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba932cab-c175-4eb1-8a31-1387239d55ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:32:54 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Volume 35fc701c-4d6f-48ba-829b-833fe28b57c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-35fc701c-4d6f-48ba-829b-833fe28b57c6', 'volume_size': 1, 'source_volid': '0d861a1a-3819-48e0-bda4-7a91a90acb07', 'source_volstatus': 'available'} Jun 15 07:32:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:55 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce 1G" returned: 0 in 0.889s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8af7f17-6191-4de2-8251-dc05aefede7a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:55 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8af7f17-6191-4de2-8251-dc05aefede7a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce Jun 15 07:32:55 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:55 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8af7f17-6191-4de2-8251-dc05aefede7a -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce" returned: 0 in 0.656s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:55 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce is being set with open permissions: ugo+rw Jun 15 07:32:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:55 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce Jun 15 07:32:55 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:56 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce" returned: 0 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:56 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info Jun 15 07:32:56 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:57 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info" returned: 0 in 0.657s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:57 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info is being set with open permissions: ugo+rw Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:57 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info Jun 15 07:32:57 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:57 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.info" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.616s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.423s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:32:57 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Cloning volume 0d861a1a-3819-48e0-bda4-7a91a90acb07 to volume 35fc701c-4d6f-48ba-829b-833fe28b57c6 Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=105,cinder:UPDATE=151,cinder:INSERT=45,cinder:DELETE=14 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=152,cinder:SELECT=115,cinder:INSERT=38,cinder:DELETE=10 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:32:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a0894081-ad2e-4eef-a607-5b77a933d1a9 tempest-VolumesExtendTest-94042659 None] Create snapshot completed successfully Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Creating offline snapshot 8e62c4f7-48e0-4e74-8bc4-ba57516e392c of volume 0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[26966108-5f03-43e8-9332-93f6b297c972]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:32:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:58 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:32:58 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:58 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.748s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:58 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c 1G Jun 15 07:32:58 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:32:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:32:59 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jun 15 07:32:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c 1G" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:32:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:32:59 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:32:59 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:00 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.686s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:00 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c is being set with open permissions: ugo+rw Jun 15 07:33:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:00 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:33:00 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:00 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.600s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:00 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info Jun 15 07:33:00 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:01 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:01 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info is being set with open permissions: ugo+rw Jun 15 07:33:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:01 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info Jun 15 07:33:01 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:02 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.info" returned: 0 in 0.658s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] snapshot: 8e62c4f7-48e0-4e74-8bc4-ba57516e392c, volume: 35fc701c-4d6f-48ba-829b-833fe28b57c6, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5edeed5-3079-4170-bc1f-e67d5d09c22b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:02 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:33:02 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:02 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.804s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d861a1a-3819-48e0-bda4-7a91a90acb07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380673c-9af6-4b60-a523-0d3e8b5a3507]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:03 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:33:03 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:03 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.806s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:03 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:33:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:03 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 Jun 15 07:33:03 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:08 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6" returned: 0 in 5.213s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e6d3d1-b820-4e79-8983-78ce0e9c3309]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:09 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:33:09 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:09 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.840s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:09 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:33:09 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Converted 1024.00 MB image at 196.39 MB/s Jun 15 07:33:09 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 is being set with open permissions: ugo+rw Jun 15 07:33:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:09 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 Jun 15 07:33:09 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:10 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6" returned: 0 in 0.578s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" released by "_copy_volume_from_snapshot" :: held 8.321s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-8e62c4f7-48e0-4e74-8bc4-ba57516e392c" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-8e62c4f7-48e0-4e74-8bc4-ba57516e392c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Deleting offline snapshot 8e62c4f7-48e0-4e74-8bc4-ba57516e392c of volume 0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] snapshot_file for this snap is: volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa84b9-1ca1-4e5b-b238-f2a61282cc43]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:10 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:33:10 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:10 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:INSERT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:11 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.687s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d861a1a-3819-48e0-bda4-7a91a90acb07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[13529f8c-b7af-49d8-91e3-92032f459159]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:11 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:33:11 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:11 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.681s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:11 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:33:11 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:12 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:12 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c Jun 15 07:33:12 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:13 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07.8e62c4f7-48e0-4e74-8bc4-ba57516e392c" returned: 0 in 0.615s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-8e62c4f7-48e0-4e74-8bc4-ba57516e392c" released by "_delete_snapshot" :: held 2.743s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.385s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 14.137s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af85591-acd1-4a3b-a848-4b408b121957]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba932cab-c175-4eb1-8a31-1387239d55ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fc701c-4d6f-48ba-829b-833fe28b57c6', 'volume_size': 1, 'source_volid': '0d861a1a-3819-48e0-bda4-7a91a90acb07', 'source_volstatus': 'available'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518d01a4-be94-4df9-b95d-1391563224b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Volume volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 (35fc701c-4d6f-48ba-829b-833fe28b57c6): created successfully Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518d01a4-be94-4df9-b95d-1391563224b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (7fc260b8-4925-4f39-a1d4-36a411530883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d3012cf3-7756-4671-a515-cf533f0ea656 tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:33:13 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:33:13 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:14 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce 2G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce 2G" returned: 0 in 0.128s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.933s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-23bb1ddd-e01c-4cba-af87-a0c628c2ca4f tempest-VolumesExtendTest-94042659 None] Extend volume completed successfully. Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-3361e40c-8338-47de-8646-de9e167958ce-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-3361e40c-8338-47de-8646-de9e167958ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (dd30e7a2-401f-40cc-aaf2-a3f00580750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593876e8-262e-4369-9c01-2a463c9e8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" acquired by "delete_snapshot" :: waited 0.053s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-quobyte-3361e40c-8338-47de-8646-de9e167958ce" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593876e8-262e-4369-9c01-2a463c9e8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1549239247',display_name='tempest-VolumesGetTest-Volume-94188961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae38f95-cbc8-4a6c-a864-f4d91734a36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:14Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1e0f6a-cc5c-4543-b8c3-d7d50e93ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a1e0f6a-cc5c-4543-b8c3-d7d50e93ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373d928c-723d-41a7-8a13-32361d0034fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (373d928c-723d-41a7-8a13-32361d0034fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae38f95-cbc8-4a6c-a864-f4d91734a36e', 'volume_name': 'volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2fc259-7338-4b78-8f3a-b9620ed4416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de2fc259-7338-4b78-8f3a-b9620ed4416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e69df0e-8ce5-43c0-933b-c949aab5fb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:14 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Volume eae38f95-cbc8-4a6c-a864-f4d91734a36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e', 'volume_size': 1} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1549239247',display_name='tempest-VolumesGetTest-Volume-94188961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae38f95-cbc8-4a6c-a864-f4d91734a36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:14Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Creating volume eae38f95-cbc8-4a6c-a864-f4d91734a36e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:14 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-3361e40c-8338-47de-8646-de9e167958ce" acquired by "_delete_snapshot" :: waited 0.086s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Deleting offline snapshot 3361e40c-8338-47de-8646-de9e167958ce of volume c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:14 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e 1073741824 Jun 15 07:33:14 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] snapshot_file for this snap is: volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5977cfed-74f2-4eb5-a920-d438c2d8ba31]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:14 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce Jun 15 07:33:14 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:15 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e 1073741824" returned: 0 in 0.789s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:15 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce" returned: 0 in 0.746s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8af7f17-6191-4de2-8251-dc05aefede7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b758d47-f92f-4660-b904-82f5cd8bf864]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:15 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e Jun 15 07:33:15 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:15 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:33:15 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:16 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e" returned: 0 in 0.596s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e69df0e-8ce5-43c0-933b-c949aab5fb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7570ec38-04ec-4cb1-92c7-e4c1f8a7394f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:16 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Volume volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e (eae38f95-cbc8-4a6c-a864-f4d91734a36e): created successfully Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7570ec38-04ec-4cb1-92c7-e4c1f8a7394f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (dd30e7a2-401f-40cc-aaf2-a3f00580750b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-da9fd995-a507-443e-9e9a-23c586099c3b tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:33:16 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.737s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:16 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce Jun 15 07:33:16 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-eae38f95-cbc8-4a6c-a864-f4d91734a36e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "cinder-eae38f95-cbc8-4a6c-a864-f4d91734a36e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-eae38f95-cbc8-4a6c-a864-f4d91734a36e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-eae38f95-cbc8-4a6c-a864-f4d91734a36e" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cb6c4c-5289-4356-96f2-18d4f13345d6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:16 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e Jun 15 07:33:16 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:17 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce" returned: 0 in 0.820s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:17 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce Jun 15 07:33:17 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:17 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e" returned: 0 in 0.756s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:17 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e Jun 15 07:33:17 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:17 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a.3361e40c-8338-47de-8646-de9e167958ce" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-3361e40c-8338-47de-8646-de9e167958ce" released by "_delete_snapshot" :: held 3.103s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" released by "delete_snapshot" :: held 3.197s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Created reservations ['9390a488-491e-41cc-a592-f04d2be75dd6', '3e30888f-4dd3-4127-97f4-a0eca8de0208', '2b69c9dc-4705-4bbf-a812-3830293f8ccf', '1bd5a6fb-61ed-4363-8824-b89d1771ff3b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:17 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Delete snapshot completed successfully. Jun 15 07:33:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-66c3dee5-1770-4cc7-8407-3bfa8eac67b6 tempest-VolumesExtendTest-94042659 None] Lock "cinder-3361e40c-8338-47de-8646-de9e167958ce-delete_snapshot" released by "delete_snapshot" :: held 3.491s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Flow 'volume_create_manager' (af6dc506-fca6-4a0e-9bd2-68cbbcd984a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d0d1eb-af1c-4f73-a34e-eb75aed41fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1d0d1eb-af1c-4f73-a34e-eb75aed41fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-844793148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f6bf40-c4e3-4916-b05b-455aa54e0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a76b5cd51a4a858c448e036b8abec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:18Z,use_quota=True,user_id='79f97f7060bb4ce0af6a51f9bf0a1fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e0192a-92b6-4870-8643-31e9230587c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e0192a-92b6-4870-8643-31e9230587c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917a4aa6-994f-4006-b129-d740b3e0e846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917a4aa6-994f-4006-b129-d740b3e0e846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f6bf40-c4e3-4916-b05b-455aa54e0969', 'volume_name': 'volume-76f6bf40-c4e3-4916-b05b-455aa54e0969', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb561e2-8895-40ff-b707-71800b3a60db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb561e2-8895-40ff-b707-71800b3a60db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46af90be-82a7-45ec-a9dd-13f95100926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:18 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Volume 76f6bf40-c4e3-4916-b05b-455aa54e0969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f6bf40-c4e3-4916-b05b-455aa54e0969', 'volume_size': 1} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-844793148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f6bf40-c4e3-4916-b05b-455aa54e0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a76b5cd51a4a858c448e036b8abec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:18Z,use_quota=True,user_id='79f97f7060bb4ce0af6a51f9bf0a1fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Creating volume 76f6bf40-c4e3-4916-b05b-455aa54e0969 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:18 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:18 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 1073741824 Jun 15 07:33:18 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:18 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-eae38f95-cbc8-4a6c-a864-f4d91734a36e" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-eae38f95-cbc8-4a6c-a864-f4d91734a36e" released by "delete_volume" :: held 1.472s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Created reservations ['b181aecc-7b95-4d09-b8a9-1fd3a6b52cc9', 'ab2915c5-097c-4838-a118-cb844cc4f40f', 'e175c1a4-7735-4a98-afbe-3a9dde71bd4a', '7542c8bf-2973-437f-8252-2e9bc02609b9'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:18 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:18 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-c8af7f17-6191-4de2-8251-dc05aefede7a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "cinder-c8af7f17-6191-4de2-8251-dc05aefede7a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Acquiring lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb60a3b9-4818-4301-8e22-bfc4699908da]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:19 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:33:19 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:19 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 1073741824" returned: 0 in 0.958s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:19 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.686s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:33:19 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 Jun 15 07:33:19 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-35fc701c-4d6f-48ba-829b-833fe28b57c6-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6ef86d44-0d48-4433-90b2-7a51ad1b6fdc tempest-VolumesGetTest-842717435 None] Lock "cinder-eae38f95-cbc8-4a6c-a864-f4d91734a36e-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "cinder-35fc701c-4d6f-48ba-829b-833fe28b57c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab9e6a-4373-4507-bc8c-3cfdc4876931]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:19 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 Jun 15 07:33:19 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:19 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.757s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:19 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a Jun 15 07:33:19 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:19 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969" returned: 0 in 0.667s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46af90be-82a7-45ec-a9dd-13f95100926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f6bf40-c4e3-4916-b05b-455aa54e0969', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef9969b-1e15-43d9-a578-4c3bce41a8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:19 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Volume volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 (76f6bf40-c4e3-4916-b05b-455aa54e0969): created successfully Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef9969b-1e15-43d9-a578-4c3bce41a8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Flow 'volume_create_manager' (af6dc506-fca6-4a0e-9bd2-68cbbcd984a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-edf8bc8b-be56-410b-962a-941a602c6e24 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Created volume successfully. Jun 15 07:33:19 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:20 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6 Jun 15 07:33:20 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:20 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c8af7f17-6191-4de2-8251-dc05aefede7a" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "cinder-quobyte-c8af7f17-6191-4de2-8251-dc05aefede7a" released by "delete_volume" :: held 1.510s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Created reservations ['7edafb96-c2ba-4802-aa1f-9789cb7b33c9', '2cedc23c-cbad-4510-99af-c36e31c254a1', 'b171228d-0271-4938-b108-e823e23c1d0a', '4d7cd801-bcbc-43f9-8c3c-be10edaa85db'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:20 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:20 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:20 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-35fc701c-4d6f-48ba-829b-833fe28b57c6" returned: 0 in 0.654s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-35fc701c-4d6f-48ba-829b-833fe28b57c6" released by "delete_volume" :: held 1.436s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Created reservations ['9265b69b-ceee-420c-bdc0-59c8f795af0e', '077f828a-3057-43eb-bb46-6ea0afd27c4c', 'facbe463-5c80-4532-becf-1d88a0cb9271', '1fdbf4d6-589a-4a93-b7bf-9a0b440c09fb'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:20 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:20 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:21 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.650s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Deleted volume successfully. Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-59012fd9-1d91-45f1-a3c4-f2f6d5227d89 tempest-VolumesExtendTest-94042659 None] Lock "cinder-c8af7f17-6191-4de2-8251-dc05aefede7a-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:21 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.636s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51ace1fd-2886-4cf5-ae75-264860f2132f tempest-VolumesGetTest-842717435 None] Lock "cinder-35fc701c-4d6f-48ba-829b-833fe28b57c6-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-0d861a1a-3819-48e0-bda4-7a91a90acb07-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "cinder-0d861a1a-3819-48e0-bda4-7a91a90acb07-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-0d861a1a-3819-48e0-bda4-7a91a90acb07" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-0d861a1a-3819-48e0-bda4-7a91a90acb07" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50202d4-1d5a-4ab7-97ce-08767f7cb7f2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:21 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:33:21 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:22 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:22 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07 Jun 15 07:33:22 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:23 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-0d861a1a-3819-48e0-bda4-7a91a90acb07" returned: 0 in 0.658s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-0d861a1a-3819-48e0-bda4-7a91a90acb07" released by "delete_volume" :: held 1.576s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Created reservations ['6445b2d3-5410-4bdb-a585-f6b2aefabd07', '689b0c15-7c89-47f5-bb46-42d6231a35bc', 'e2d09788-f847-40da-8b47-acd64e7a1338', '718eb067-1683-48a8-ad74-2b5628cdfdcc'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:23 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:23 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[142850f0-c907-4b79-a99e-e0d31599af36]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:23 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 Jun 15 07:33:23 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:23 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.684s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:23 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2e6ff969-fa04-489d-84e1-0534299172bc tempest-VolumesGetTest-842717435 None] Lock "cinder-0d861a1a-3819-48e0-bda4-7a91a90acb07-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Flow 'volume_create_manager' (692ad971-a2c8-4d58-b141-19a587c3207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2a70db-d7c7-428c-8e96-771b9682bd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2a70db-d7c7-428c-8e96-771b9682bd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1232585537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95bf435-a3c0-4838-9b64-d2db2a3e2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09099c3bb13249258e0aa4f478dd83a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:24Z,use_quota=True,user_id='8b2cb57ebc494606887f1099faa380e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4d90dd-1709-422c-a8d8-055c3d03cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4d90dd-1709-422c-a8d8-055c3d03cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cdb73-8416-4976-8ed0-e5ec9d33c2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1cdb73-8416-4976-8ed0-e5ec9d33c2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95bf435-a3c0-4838-9b64-d2db2a3e2c06', 'volume_name': 'volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a003f22a-4a4e-48ad-85f7-4ebd3fc618b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a003f22a-4a4e-48ad-85f7-4ebd3fc618b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b25513-a5d4-4c9e-a616-dc51f58961f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06', 'volume_size': 1} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:24 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969" returned: 0 in 0.821s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.837s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.247s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1232585537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95bf435-a3c0-4838-9b64-d2db2a3e2c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09099c3bb13249258e0aa4f478dd83a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:24Z,use_quota=True,user_id='8b2cb57ebc494606887f1099faa380e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Creating volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:24 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:24 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 1073741824 Jun 15 07:33:24 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-76f6bf40-c4e3-4916-b05b-455aa54e0969', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca5a2933-710c-46d1-b7fe-8aa89e50c8f7', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:33:24 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-88c245b1-0c78-42da-888e-b77e6896827c req-013b8e39-3a02-4459-b19c-0de18f485c49 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] attachment_update completed successfully. Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (a4c96a28-c983-469b-9489-73e74bb6a7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ab45e4-3e4a-49e0-9d8b-1201d48bd1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ab45e4-3e4a-49e0-9d8b-1201d48bd1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-568741487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f6772f-b18c-442a-9a41-d7047db77ccf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:25Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdf28d7-0799-4cb1-bcb2-f343220bdd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdf28d7-0799-4cb1-bcb2-f343220bdd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36074848-c3af-4a87-a7a7-093bb13ab958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:24 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36074848-c3af-4a87-a7a7-093bb13ab958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1f6772f-b18c-442a-9a41-d7047db77ccf', 'volume_name': 'volume-d1f6772f-b18c-442a-9a41-d7047db77ccf', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f995d1-b38f-4c2c-931b-c2eb6b35bcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f995d1-b38f-4c2c-931b-c2eb6b35bcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e047a-7cb2-46c3-b8bf-bb15bc27151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:25 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Volume d1f6772f-b18c-442a-9a41-d7047db77ccf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1f6772f-b18c-442a-9a41-d7047db77ccf', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Trying to clone d1f6772f-b18c-442a-9a41-d7047db77ccf from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c at location (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:33:25 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 1073741824" returned: 0 in 0.950s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:33:25 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f4b6c-cb75-4dea-ab9c-bbd132563c85]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:25 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 Jun 15 07:33:25 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:25 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD Jun 15 07:33:25 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:26 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" returned: 0 in 0.697s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b25513-a5d4-4c9e-a616-dc51f58961f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2cfa70-6dc6-4144-99ae-084a5f206595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:26 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c is fetched for user f7e056944dde43e797addaf51e6bde22. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:33:26 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Volume volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 (f95bf435-a3c0-4838-9b64-d2db2a3e2c06): created successfully Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2cfa70-6dc6-4144-99ae-084a5f206595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Flow 'volume_create_manager' (692ad971-a2c8-4d58-b141-19a587c3207e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ba8d8234-b467-45d2-bb02-4ec7c754f647 tempest-VolumesSnapshotListTestJSON-623824463 None] Created volume successfully. Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5035236-7b25-4341-88c2-c9de91c2c111]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:26 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD Jun 15 07:33:26 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:26 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-568741487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f6772f-b18c-442a-9a41-d7047db77ccf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:25Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Creating volume d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:27 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:27 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1073741824 Jun 15 07:33:27 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:27 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1073741824" returned: 0 in 0.756s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:27 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:27 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:28 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.887s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Creating offline snapshot 3d98b3f7-d2f5-429d-be66-517b0765eb38 of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Attempting download of 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume d1f6772f-b18c-442a-9a41-d7047db77ccf. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d39bfa-f461-4420-a90d-97f4d9eb6c89]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4631ca45-0906-47b7-9a96-1fca7d07a0cd]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:28 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 Jun 15 07:33:28 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:28 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6 Jun 15 07:33:28 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:29 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" returned: 0 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:29 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 1G Jun 15 07:33:29 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:29 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:29 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6 Jun 15 07:33:29 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:29 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6" returned: 1 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_e1f7sws6' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103fe95-d939-49ea-97ce-715adb568f9e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:29 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 1G" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:29 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:29 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:29 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD Jun 15 07:33:29 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:30 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:30 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c was qcow2, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:33:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:30 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:30 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:30 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.666s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:30 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 is being set with open permissions: ugo+rw Jun 15 07:33:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:30 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:30 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:31 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.632s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:31 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info Jun 15 07:33:31 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-0a7f4fde-6242-46aa-a287-370182e177fc req-d406cbf1-9b01-4148-b92c-2ec4c5b8e3a8 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Terminate volume connection completed successfully. Jun 15 07:33:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-0a7f4fde-6242-46aa-a287-370182e177fc req-d406cbf1-9b01-4148-b92c-2ec4c5b8e3a8 tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Deleting attachment ca5a2933-710c-46d1-b7fe-8aa89e50c8f7. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:33:31 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info" returned: 0 in 0.681s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:31 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info is being set with open permissions: ugo+rw Jun 15 07:33:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:31 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info Jun 15 07:33:31 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:32 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 0 in 1.897s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c__yi0lf8rdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:33:32 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Converted 112.00 MB image at 58.99 MB/s Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:32 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1G Jun 15 07:33:32 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:32 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.info" returned: 0 in 0.600s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.174s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6d429986-103f-40eb-98fa-8670c4473cf6 tempest-VolumesSnapshotListTestJSON-623824463 None] Create snapshot completed successfully Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Creating offline snapshot ccbbc72b-4498-4343-bd82-e24c076d1351 of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[77767938-fcf8-421b-a4ea-790a63a8c631]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:33 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:33 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:33 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf 1G" returned: 0 in 0.645s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e894f22-2175-445a-84da-ecd17a20e092]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:33 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:33 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:33 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:33 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 1G Jun 15 07:33:33 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "cinder-76f6bf40-c4e3-4916-b05b-455aa54e0969-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:33 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "cinder-76f6bf40-c4e3-4916-b05b-455aa54e0969-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 0 in 0.750s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "cinder-quobyte-76f6bf40-c4e3-4916-b05b-455aa54e0969" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "cinder-quobyte-76f6bf40-c4e3-4916-b05b-455aa54e0969" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288f2d3-79ad-4493-9683-1d8e0b2a96b0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:33 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:33 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:34 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 Jun 15 07:33:34 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:34 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 1G" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:34 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:34 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:34 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 1 in 0.734s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Downloaded image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume d1f6772f-b18c-442a-9a41-d7047db77ccf successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c for user f7e056944dde43e797addaf51e6bde22 is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Marking volume d1f6772f-b18c-442a-9a41-d7047db77ccf as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Copying metadata from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c to d1f6772f-b18c-442a-9a41-d7047db77ccf. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Creating volume glance metadata for volume d1f6772f-b18c-442a-9a41-d7047db77ccf backed by image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554e047a-7cb2-46c3-b8bf-bb15bc27151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f6772f-b18c-442a-9a41-d7047db77ccf', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4e8b7-15a0-4310-8a27-69fe8492258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Volume volume-d1f6772f-b18c-442a-9a41-d7047db77ccf (d1f6772f-b18c-442a-9a41-d7047db77ccf): created successfully Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db4e8b7-15a0-4310-8a27-69fe8492258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (a4c96a28-c983-469b-9489-73e74bb6a7f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:34 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969" returned: 0 in 0.774s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6f63163c-aaac-4d12-b18d-dd0f41f740c9 tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:33:34 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969 Jun 15 07:33:34 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:35 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.651s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:35 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 is being set with open permissions: ugo+rw Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:35 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:35 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:35 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-76f6bf40-c4e3-4916-b05b-455aa54e0969" returned: 0 in 0.636s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "cinder-quobyte-76f6bf40-c4e3-4916-b05b-455aa54e0969" released by "delete_volume" :: held 1.452s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Created reservations ['36f70202-6560-408c-a99d-a17f9ccd3176', 'fa395db9-f9d6-44b5-8193-45d22c109dd9', '3404ad69-8317-4c41-ac5f-2cdb7c4d939b', '0db9f07e-2256-4e8a-9c0f-2146184da372'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:35 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:35 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:35 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c0e0349c-1562-4f36-9edf-b67e92c14a99 tempest-VolumesSnapshotListTestJSON-623824463 None] Create snapshot completed successfully Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (65dc3cf9-36df-40e4-aada-d99905366a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb7a799-4384-421c-a014-16b174d11422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb7a799-4384-421c-a014-16b174d11422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1495915111',display_name='tempest-VolumesGetTest-Volume-1300616780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:36Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79019ccc-e946-470e-80fe-3fcce18e2a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79019ccc-e946-470e-80fe-3fcce18e2a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09795a37-8b1f-4045-abd6-d6c45b871e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09795a37-8b1f-4045-abd6-d6c45b871e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3', 'volume_name': 'volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac86a32b-5d68-481b-8eac-7e269cb761a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac86a32b-5d68-481b-8eac-7e269cb761a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa59799-d746-43a9-8fce-4a47daef5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Volume 3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3', 'volume_size': 1} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1495915111',display_name='tempest-VolumesGetTest-Volume-1300616780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01dabdb4e2ec4cf3b7b6d1d41f0ef1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:36Z,use_quota=True,user_id='f7e056944dde43e797addaf51e6bde22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Creating volume 3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:36 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:36 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 1073741824 Jun 15 07:33:36 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:36 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.795s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Deleted volume successfully. Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9b4df4fc-75a0-439c-b3e7-f837f1f9497d tempest-TestServerVolumeAttachScenarioOldVersion-1092674943 None] Lock "cinder-76f6bf40-c4e3-4916-b05b-455aa54e0969-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:36 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 1073741824" returned: 0 in 0.824s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:37 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 Jun 15 07:33:37 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:37 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" returned: 0 in 0.727s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.469s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Creating offline snapshot 22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa59799-d746-43a9-8fce-4a47daef5079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973fd885-5923-4de5-9823-f066f5f0793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[121140c9-a491-4961-83c7-fb4d4ac3d3f5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Volume volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 (3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3): created successfully Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973fd885-5923-4de5-9823-f066f5f0793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Flow 'volume_create_manager' (65dc3cf9-36df-40e4-aada-d99905366a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1d6cb5b9-d2c2-44a8-ae7d-ee59ad4da185 tempest-VolumesGetTest-842717435 None] Created volume successfully. Jun 15 07:33:37 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:37 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "cinder-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1ea58-d9d5-47ec-97df-f3d9f33bcfa9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:38 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 Jun 15 07:33:38 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:38 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.934s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:38 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f 1G Jun 15 07:33:38 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:39 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" returned: 0 in 0.800s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:39 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3 Jun 15 07:33:39 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:39 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f 1G" returned: 0 in 0.995s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:39 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f Jun 15 07:33:39 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:40 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" returned: 0 in 0.687s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3" released by "delete_volume" :: held 1.542s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Created reservations ['09750185-bb79-4679-b969-75c3e71a93bc', '4ab5dc39-cadf-40a3-9a88-08fc12b21af9', '5bc89b4b-fae2-455c-9392-857f321f7053', '90c1cb8f-775b-42cc-aaa2-d2cbd629d0c8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:40 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:40 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:40 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" returned: 0 in 0.705s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:40 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f is being set with open permissions: ugo+rw Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:40 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f Jun 15 07:33:40 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-d1f6772f-b18c-442a-9a41-d7047db77ccf-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "cinder-d1f6772f-b18c-442a-9a41-d7047db77ccf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Acquiring lock "cinder-quobyte-d1f6772f-b18c-442a-9a41-d7047db77ccf" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-d1f6772f-b18c-442a-9a41-d7047db77ccf" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:40 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:40 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cf937b3b-81ca-48e2-9897-96c0ad7d1209 tempest-VolumesGetTest-842717435 None] Lock "cinder-3cff0ede-cf32-4f27-a3a5-e4f4d0206ff3-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d7bcb-149e-48c1-a4fa-bf6c2d850f04]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:41 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:41 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:41 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" returned: 0 in 0.622s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.372s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-af001848-1a08-4188-b358-8e64a961a56f tempest-VolumesSnapshotListTestJSON-623824463 None] Create snapshot completed successfully Jun 15 07:33:41 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 0 in 0.746s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:41 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:41 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:42 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 1 in 0.786s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:42 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf Jun 15 07:33:42 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Deleting offline snapshot 22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] snapshot_file for this snap is: volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7215df00-2951-4b82-a495-5390ecfd858e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:42 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f Jun 15 07:33:42 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:43 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d1f6772f-b18c-442a-9a41-d7047db77ccf" returned: 0 in 0.641s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "cinder-quobyte-d1f6772f-b18c-442a-9a41-d7047db77ccf" released by "delete_volume" :: held 2.250s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Created reservations ['5850bbf4-e962-43cc-aa43-ddafaabf56e5', '90133ca9-22e4-424d-afe3-2c3fd1ed4f84', '39467f8f-cf71-4b9b-adbb-efb3c517371b', '4de961c0-b92f-470f-abda-643a0253e0d8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:43 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:43 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:43 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" returned: 0 in 0.776s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7167ac-fd30-40dc-ac9a-20858691bdc8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:43 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:43 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:43 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.610s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Deleted volume successfully. Jun 15 07:33:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-54ccdec9-4e41-4999-9a1e-63e4815b96ce tempest-VolumesGetTest-842717435 None] Lock "cinder-d1f6772f-b18c-442a-9a41-d7047db77ccf-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:44 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.787s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:44 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f Jun 15 07:33:44 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:45 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" returned: 0 in 0.959s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:45 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f Jun 15 07:33:45 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:45 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" returned: 0 in 0.641s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f" released by "_delete_snapshot" :: held 3.268s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" released by "delete_snapshot" :: held 3.287s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Created reservations ['a351aa35-ee16-4f48-b687-2e0cc37b54a7', '1e71e688-c1cd-42b5-9a21-ea1c3697ad44', '291a6515-2334-451b-91d5-cda4950f6a04', '37eb6474-c0d5-4fcd-b99a-3efde972a6e8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Delete snapshot completed successfully. Jun 15 07:33:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-121c59cd-4815-48d3-9cd8-307b7c5e6aff tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-22eabdf6-81d0-4bd1-b6d7-47cbafe14a3f-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:46 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:46 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-ccbbc72b-4498-4343-bd82-e24c076d1351-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-ccbbc72b-4498-4343-bd82-e24c076d1351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" acquired by "delete_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-ccbbc72b-4498-4343-bd82-e24c076d1351" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-ccbbc72b-4498-4343-bd82-e24c076d1351" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Deleting offline snapshot ccbbc72b-4498-4343-bd82-e24c076d1351 of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] snapshot_file for this snap is: volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[70079e6f-0cc5-4744-b36d-bbdc9641d530]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:47 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:47 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Flow 'volume_create_manager' (59840880-8716-48f9-adb5-eb67a2ba1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e402a401-92ee-4a0e-be14-ffb19d636f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e402a401-92ee-4a0e-be14-ffb19d636f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1075948924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220b7212-307c-4bc8-bd53-404378fff167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274ed727a7c4321b64c84403fd957cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:47Z,use_quota=True,user_id='f3a1397186654efd86f0d9c9e57096e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45639911-739f-48d8-a404-f8bab5e1df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45639911-739f-48d8-a404-f8bab5e1df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04697a7-1d7b-48dc-a9f2-945c4fc5956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04697a7-1d7b-48dc-a9f2-945c4fc5956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220b7212-307c-4bc8-bd53-404378fff167', 'volume_name': 'volume-220b7212-307c-4bc8-bd53-404378fff167', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab146d-2b04-4077-b779-9ced18fa1c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddab146d-2b04-4077-b779-9ced18fa1c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad818ebf-2d6e-4ca6-b361-574279364f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:47 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Volume 220b7212-307c-4bc8-bd53-404378fff167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220b7212-307c-4bc8-bd53-404378fff167', 'volume_size': 1} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1075948924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220b7212-307c-4bc8-bd53-404378fff167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d274ed727a7c4321b64c84403fd957cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:33:47Z,use_quota=True,user_id='f3a1397186654efd86f0d9c9e57096e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Creating volume 220b7212-307c-4bc8-bd53-404378fff167 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:33:47 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:47 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 1073741824 Jun 15 07:33:47 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:47 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.921s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:33:47 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.873s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2073788-adfc-4126-a16c-c3d09c3b3def]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:47 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:47 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:48 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 1073741824" returned: 0 in 0.967s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:48 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 Jun 15 07:33:48 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:48 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.824s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:48 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:48 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:49 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167" returned: 0 in 0.684s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad818ebf-2d6e-4ca6-b361-574279364f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220b7212-307c-4bc8-bd53-404378fff167', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67880eef-200f-4b0e-8327-0767077e2640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:33:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Volume volume-220b7212-307c-4bc8-bd53-404378fff167 (220b7212-307c-4bc8-bd53-404378fff167): created successfully Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67880eef-200f-4b0e-8327-0767077e2640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Flow 'volume_create_manager' (59840880-8716-48f9-adb5-eb67a2ba1158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:33:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3240f7fd-f7ec-4196-ba3a-d1db4f8d2d3c tempest-VolumesNegativeTest-1180565842 None] Created volume successfully. Jun 15 07:33:49 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.836s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:49 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351 Jun 15 07:33:49 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:50 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.ccbbc72b-4498-4343-bd82-e24c076d1351" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-ccbbc72b-4498-4343-bd82-e24c076d1351" released by "_delete_snapshot" :: held 3.367s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" released by "delete_snapshot" :: held 3.409s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Created reservations ['cdde0e43-8556-4ca0-92d2-92e46172d2fe', '0c194d6d-9482-4bef-bc6e-a83ec6538982', 'aae5597b-3b02-4d11-9eab-75afd2eadce8', 'f39c72dd-673c-46f9-9c12-f42933e88e5f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Delete snapshot completed successfully. Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fa121c76-8487-44c8-b26e-5476fc970e20 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-ccbbc72b-4498-4343-bd82-e24c076d1351-delete_snapshot" released by "delete_snapshot" :: held 3.566s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-3d98b3f7-d2f5-429d-be66-517b0765eb38-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-3d98b3f7-d2f5-429d-be66-517b0765eb38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-3d98b3f7-d2f5-429d-be66-517b0765eb38" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-3d98b3f7-d2f5-429d-be66-517b0765eb38" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Deleting offline snapshot 3d98b3f7-d2f5-429d-be66-517b0765eb38 of volume f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] snapshot_file for this snap is: volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4649448a-acbc-4b4b-9872-fdc4888eafc9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:51 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:51 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:51 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.842s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce1be58-9025-433c-9593-0ff9914ef8d1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:52 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 Jun 15 07:33:52 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:52 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" returned: 0 in 0.870s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:52 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:52 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:53 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.843s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:53 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38 Jun 15 07:33:53 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:54 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06.3d98b3f7-d2f5-429d-be66-517b0765eb38" returned: 0 in 0.669s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-3d98b3f7-d2f5-429d-be66-517b0765eb38" released by "_delete_snapshot" :: held 3.351s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" released by "delete_snapshot" :: held 3.377s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:54 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Created reservations ['effadfdd-7511-4edc-a564-c5a37ff85a01', '1cf0c298-052a-49fb-9845-9c8e7f18ef2b', '6a620d7d-8578-4e36-91dd-fc855d144007', '8b6a9a4f-b608-49a8-afef-a7ea459f6517'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:54 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Delete snapshot completed successfully. Jun 15 07:33:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-94260221-fe70-4d11-96b0-ede0edbc7d29 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-3d98b3f7-d2f5-429d-be66-517b0765eb38-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-f95bf435-a3c0-4838-9b64-d2db2a3e2c06-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-f95bf435-a3c0-4838-9b64-d2db2a3e2c06-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a125716a-97da-492e-a279-d969e02cbb2b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:33:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:55 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 Jun 15 07:33:55 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:56 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" returned: 0 in 0.837s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:56 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06 Jun 15 07:33:56 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:57 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" returned: 0 in 0.817s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-quobyte-f95bf435-a3c0-4838-9b64-d2db2a3e2c06" released by "delete_volume" :: held 1.750s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Created reservations ['1226355d-4c35-486f-88ab-7b1fa861c7a9', '9a93f13e-a71a-4bfb-9814-331ace004afe', '2c7fb594-be6b-47e4-b84c-8fc2d9c16297', '0cd16c51-5762-4fc8-8552-62e95a3243e4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:33:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:33:57 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:33:57 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:33:58 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jun 15 07:33:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.716s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:33:58 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:33:58 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Deleted volume successfully. Jun 15 07:33:58 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=103,cinder:UPDATE=104,cinder:DELETE=9,cinder:INSERT=30 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:33:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a376ff01-fef7-4677-adec-250a498d0ed6 tempest-VolumesSnapshotListTestJSON-623824463 None] Lock "cinder-f95bf435-a3c0-4838-9b64-d2db2a3e2c06-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:00 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Flow 'volume_create_manager' (0f24c5f3-d196-42b7-9052-7e46434b37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54e40f1-bed3-4d88-b6ed-d8f3e26259e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a54e40f1-bed3-4d88-b6ed-d8f3e26259e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1552134287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911a7946-2f58-43d9-b64f-80a11e25c3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e33d22c39746b3a5fa039462e5631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:01Z,use_quota=True,user_id='283eda73985b405d89ff128978ce501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:00 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8fe1cf-bafa-45b1-bbd5-9a3aac67fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8fe1cf-bafa-45b1-bbd5-9a3aac67fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41477d7e-1842-4592-b61e-0d9e9d39e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41477d7e-1842-4592-b61e-0d9e9d39e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '911a7946-2f58-43d9-b64f-80a11e25c3ee', 'volume_name': 'volume-911a7946-2f58-43d9-b64f-80a11e25c3ee', 'volume_size': 2}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f36967-e2fd-41f7-b7f5-9ea7e979d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f36967-e2fd-41f7-b7f5-9ea7e979d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00412e2-773d-47ce-b33a-463b2ade12e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:01 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Volume 911a7946-2f58-43d9-b64f-80a11e25c3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-911a7946-2f58-43d9-b64f-80a11e25c3ee', 'volume_size': 2} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1552134287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=911a7946-2f58-43d9-b64f-80a11e25c3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0e33d22c39746b3a5fa039462e5631a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:01Z,use_quota=True,user_id='283eda73985b405d89ff128978ce501e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Creating volume 911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:01 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee 2147483648 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:01 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee 2147483648 Jun 15 07:34:01 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:02 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee 2147483648" returned: 0 in 1.019s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:02 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee Jun 15 07:34:02 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:02 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee" returned: 0 in 0.603s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00412e2-773d-47ce-b33a-463b2ade12e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-911a7946-2f58-43d9-b64f-80a11e25c3ee', 'volume_size': 2}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cfad84-7ad5-4124-aed0-b81a07f40040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Volume volume-911a7946-2f58-43d9-b64f-80a11e25c3ee (911a7946-2f58-43d9-b64f-80a11e25c3ee): created successfully Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cfad84-7ad5-4124-aed0-b81a07f40040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Flow 'volume_create_manager' (0f24c5f3-d196-42b7-9052-7e46434b37ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-7e68184a-82b7-4902-9c79-73b28253923d tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Created volume successfully. Jun 15 07:34:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Creating offline snapshot 400c27fc-e6ba-45e8-b4bd-3c990df0d71f of volume 911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:34:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a9c633-d17d-4100-8cad-bb7f55c0d5cd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:03 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee Jun 15 07:34:03 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:04 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee" returned: 0 in 0.996s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f 2G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:04 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f 2G Jun 15 07:34:04 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:05 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f 2G" returned: 0 in 1.077s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911a7946-2f58-43d9-b64f-80a11e25c3ee -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:05 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911a7946-2f58-43d9-b64f-80a11e25c3ee -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f Jun 15 07:34:05 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:06 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-911a7946-2f58-43d9-b64f-80a11e25c3ee -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f" returned: 0 in 0.943s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:06 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f is being set with open permissions: ugo+rw Jun 15 07:34:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:06 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f Jun 15 07:34:06 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:07 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f" returned: 0 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:07 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info Jun 15 07:34:07 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:08 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info" returned: 0 in 1.109s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:08 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info is being set with open permissions: ugo+rw Jun 15 07:34:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:08 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info Jun 15 07:34:08 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:09 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.info" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.720s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0f46496a-035f-4086-92aa-301d078393c3 tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Create snapshot completed successfully Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "cinder-400c27fc-e6ba-45e8-b4bd-3c990df0d71f-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-400c27fc-e6ba-45e8-b4bd-3c990df0d71f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "cinder-quobyte-400c27fc-e6ba-45e8-b4bd-3c990df0d71f" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-400c27fc-e6ba-45e8-b4bd-3c990df0d71f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Deleting offline snapshot 400c27fc-e6ba-45e8-b4bd-3c990df0d71f of volume 911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] snapshot_file for this snap is: volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fa3ed-c831-4b48-831a-b399733ac09f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:10 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f Jun 15 07:34:10 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:10 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f" returned: 0 in 0.778s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-911a7946-2f58-43d9-b64f-80a11e25c3ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:34:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[df577692-7ded-4542-883d-dcaee6a64611]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:10 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee Jun 15 07:34:10 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:11 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee" returned: 0 in 0.843s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:11 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f Jun 15 07:34:11 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:12 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f" returned: 0 in 0.807s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:12 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f Jun 15 07:34:12 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:13 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee.400c27fc-e6ba-45e8-b4bd-3c990df0d71f" returned: 0 in 0.628s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=135,cinder:INSERT=40,cinder:SELECT=100,cinder:DELETE=12 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-400c27fc-e6ba-45e8-b4bd-3c990df0d71f" released by "_delete_snapshot" :: held 3.192s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" released by "delete_snapshot" :: held 3.230s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Created reservations ['849b65f6-9a2e-4263-892d-814b42804331', '07be7dc2-f60d-43b8-920b-4f0abffbd2d2', '0258cbe0-fe1f-45d1-b07e-a5f1f1ca5b68', 'ded1f368-b07a-4457-ac1c-6f0342cbd0de'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Delete snapshot completed successfully. Jun 15 07:34:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d8a415d6-ffab-41fa-a5de-38ff2203eddd tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-400c27fc-e6ba-45e8-b4bd-3c990df0d71f-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "cinder-911a7946-2f58-43d9-b64f-80a11e25c3ee-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-911a7946-2f58-43d9-b64f-80a11e25c3ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eeec25-4eb6-4f18-ac37-2d9c55667ea1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:14 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee Jun 15 07:34:14 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:15 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee" returned: 0 in 0.786s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:15 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee Jun 15 07:34:15 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:15 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-911a7946-2f58-43d9-b64f-80a11e25c3ee" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-quobyte-911a7946-2f58-43d9-b64f-80a11e25c3ee" released by "delete_volume" :: held 1.676s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Created reservations ['32dbac2e-b1ea-4bad-8483-a5cde02a9eb1', '86fbc0f8-9c5d-4393-9383-9e9e217af379', 'ed66dff8-d6b0-4b96-9685-7df8ba3d4f2c', 'a3291966-b188-453e-8677-0444277b3a99'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:16 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:34:16 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:17 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.892s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:17 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:17 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Deleted volume successfully. Jun 15 07:34:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d065fb2d-ab8d-40cf-8130-d8b0f961f8ae tempest-VolumesSnapshotNegativeTestJSON-1162739723 None] Lock "cinder-911a7946-2f58-43d9-b64f-80a11e25c3ee-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Acquiring lock "cinder-220b7212-307c-4bc8-bd53-404378fff167-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "cinder-220b7212-307c-4bc8-bd53-404378fff167-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Acquiring lock "cinder-quobyte-220b7212-307c-4bc8-bd53-404378fff167" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "cinder-quobyte-220b7212-307c-4bc8-bd53-404378fff167" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8b620-205e-4fe7-a4e5-1c5d6f028d2c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:22 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 Jun 15 07:34:22 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:23 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167" returned: 0 in 0.840s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:23 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167 Jun 15 07:34:23 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:24 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-220b7212-307c-4bc8-bd53-404378fff167" returned: 0 in 0.667s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "cinder-quobyte-220b7212-307c-4bc8-bd53-404378fff167" released by "delete_volume" :: held 1.561s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Created reservations ['594dfa1f-3fd2-4bea-8428-e10163bf7287', 'd6902114-9790-4cd3-8229-eea1b0bdd0d9', '2c292489-adf9-4c59-ad51-c4e9a01aad27', '9979b0c2-9b99-4a8d-b685-bccdd81f6fc0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Flow 'volume_create_manager' (960f3d22-1490-488c-8aa8-a7692f324947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9d0b3-f47d-4a18-8918-b46461848e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9d0b3-f47d-4a18-8918-b46461848e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-39990562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e6553b-1692-4e06-baeb-916b02e5a60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87ed67c4d54653a10a7c9e81091f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:24Z,use_quota=True,user_id='7cd7c4d75bc34c2b9b2073e2e65f4529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e9efd3-cb1e-4109-8071-74a62983b56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e9efd3-cb1e-4109-8071-74a62983b56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b46ce8-bc4f-4deb-89d5-7751a9c543ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b46ce8-bc4f-4deb-89d5-7751a9c543ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e6553b-1692-4e06-baeb-916b02e5a60f', 'volume_name': 'volume-23e6553b-1692-4e06-baeb-916b02e5a60f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6b2f04-06c6-4bc9-a28b-bb8549d407cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6b2f04-06c6-4bc9-a28b-bb8549d407cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b13d2-1d0e-402a-9856-e49107530847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume 23e6553b-1692-4e06-baeb-916b02e5a60f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e6553b-1692-4e06-baeb-916b02e5a60f', 'volume_size': 1} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-39990562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e6553b-1692-4e06-baeb-916b02e5a60f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87ed67c4d54653a10a7c9e81091f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:24Z,use_quota=True,user_id='7cd7c4d75bc34c2b9b2073e2e65f4529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Creating volume 23e6553b-1692-4e06-baeb-916b02e5a60f {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:24 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:24 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f 1073741824 Jun 15 07:34:24 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:24 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:34:24 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Flow 'volume_create_manager' (10dde411-c394-4ccd-ab36-9cb839447405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d123501d-2bec-4ab7-81fd-b8a387af819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d123501d-2bec-4ab7-81fd-b8a387af819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1498013091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da26659d-62f3-4307-8613-db09a5614171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87ed67c4d54653a10a7c9e81091f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:25Z,use_quota=True,user_id='7cd7c4d75bc34c2b9b2073e2e65f4529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf170246-8af0-4310-85d2-a789e002bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf170246-8af0-4310-85d2-a789e002bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57b8161-9893-423b-b551-043ea460c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57b8161-9893-423b-b551-043ea460c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da26659d-62f3-4307-8613-db09a5614171', 'volume_name': 'volume-da26659d-62f3-4307-8613-db09a5614171', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:24 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da58ef34-74f4-4167-a550-dacb33bcea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da58ef34-74f4-4167-a550-dacb33bcea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53007746-3773-4bf3-9743-314f67fe7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:25 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume da26659d-62f3-4307-8613-db09a5614171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da26659d-62f3-4307-8613-db09a5614171', 'volume_size': 1} Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:25 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.982s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Deleted volume successfully. Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-eca08754-208d-4b42-9dfb-7261daf3ce85 tempest-VolumesNegativeTest-1180565842 None] Lock "cinder-220b7212-307c-4bc8-bd53-404378fff167-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:25 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f 1073741824" returned: 0 in 1.293s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:25 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f Jun 15 07:34:25 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:26 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.537s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1498013091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da26659d-62f3-4307-8613-db09a5614171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc87ed67c4d54653a10a7c9e81091f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:25Z,use_quota=True,user_id='7cd7c4d75bc34c2b9b2073e2e65f4529',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Creating volume da26659d-62f3-4307-8613-db09a5614171 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:26 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799b13d2-1d0e-402a-9856-e49107530847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e6553b-1692-4e06-baeb-916b02e5a60f', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:26 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 1073741824 Jun 15 07:34:26 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b3c962-6d2b-4fb0-9bdc-53bacc416456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:26 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume volume-23e6553b-1692-4e06-baeb-916b02e5a60f (23e6553b-1692-4e06-baeb-916b02e5a60f): created successfully Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b3c962-6d2b-4fb0-9bdc-53bacc416456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Flow 'volume_create_manager' (960f3d22-1490-488c-8aa8-a7692f324947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0fef7896-dfa2-4632-8404-f46b77fb63d6 tempest-TestServerVolumeAttachmentScenario-526712532 None] Created volume successfully. Jun 15 07:34:27 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 1073741824" returned: 0 in 1.088s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:27 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 Jun 15 07:34:27 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:28 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171" returned: 0 in 0.675s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53007746-3773-4bf3-9743-314f67fe7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da26659d-62f3-4307-8613-db09a5614171', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2a0744-0733-4845-a2e4-dd76a18565b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:28 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Volume volume-da26659d-62f3-4307-8613-db09a5614171 (da26659d-62f3-4307-8613-db09a5614171): created successfully Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2a0744-0733-4845-a2e4-dd76a18565b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Flow 'volume_create_manager' (10dde411-c394-4ccd-ab36-9cb839447405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6185408d-14da-407e-b983-e01052f05d91 tempest-TestServerVolumeAttachmentScenario-526712532 None] Created volume successfully. Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Flow 'volume_create_manager' (3106ad20-0907-40b0-a0ad-840738d41a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26619486-54fa-4b15-975b-3f3f72a7e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26619486-54fa-4b15-975b-3f3f72a7e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739141807a7d48698432d3c10b25066b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:32Z,use_quota=True,user_id='ee30cfccab26421e98a243bfdd4f9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf1764c4-87ad-4fa4-bd2b-6d5334947908),volume_type_id=cf1764c4-87ad-4fa4-bd2b-6d5334947908)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adc9107-5902-4dbf-a32d-7a206820c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2adc9107-5902-4dbf-a32d-7a206820c952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d5083c-5bf2-490c-a627-df6d5558c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d5083c-5bf2-490c-a627-df6d5558c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27', 'volume_name': 'volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27', 'volume_size': 1, 'image_id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c4048d8b72da848fe5e70f120d9bc53', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739141807a7d48698432d3c10b25066b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7918f53ebf968fa063c24fa5c1dd11a6f4098139ea0b4f4e5737ee12acdaa4416bec68c2130b92a322e63a48651ffb360c7058ee89ce1914e51278a915fdbbf0', 'id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'created_at': datetime.datetime(2026, 6, 15, 5, 34, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a73e7c84-77fd-470d-9604-abd42ed41469/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b96222-20be-4863-b2f0-ae5405733c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b96222-20be-4863-b2f0-ae5405733c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94a2403-369b-40b3-8526-7bf4ae0f4e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:32 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27', 'volume_size': 1, 'image_id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c4048d8b72da848fe5e70f120d9bc53', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739141807a7d48698432d3c10b25066b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7918f53ebf968fa063c24fa5c1dd11a6f4098139ea0b4f4e5737ee12acdaa4416bec68c2130b92a322e63a48651ffb360c7058ee89ce1914e51278a915fdbbf0', 'id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'created_at': datetime.datetime(2026, 6, 15, 5, 34, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a73e7c84-77fd-470d-9604-abd42ed41469/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Trying to clone fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 from image a73e7c84-77fd-470d-9604-abd42ed41469 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:34:32 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bcd164-b9be-4b19-a556-839dd5b9cb8a]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:32 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:32 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:33 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 0 in 0.744s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:33 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:33 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:34 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:34 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Temporary image a73e7c84-77fd-470d-9604-abd42ed41469 is fetched for user ee30cfccab26421e98a243bfdd4f9d9f. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:34:34 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c848a801-1703-4abc-9612-c4397626a8a0]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:34 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:34 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:35 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:35 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:35 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:36 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 1 in 0.862s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='739141807a7d48698432d3c10b25066b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:32Z,use_quota=True,user_id='ee30cfccab26421e98a243bfdd4f9d9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf1764c4-87ad-4fa4-bd2b-6d5334947908),volume_type_id=cf1764c4-87ad-4fa4-bd2b-6d5334947908)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Creating volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:36 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:36 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1073741824 Jun 15 07:34:36 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:36 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1073741824" returned: 0 in 0.828s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:36 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:36 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:37 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 0 in 0.659s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Attempting download of a73e7c84-77fd-470d-9604-abd42ed41469 ((None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}])) to volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb4ac2f-2ded-4a2b-a7aa-129de432592c]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:37 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw Jun 15 07:34:37 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:38 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw" returned: 0 in 0.693s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:38 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw Jun 15 07:34:38 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:39 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw" returned: 1 in 0.817s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a73e7c84-77fd-470d-9604-abd42ed41469_n5x0oljw' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f76a15-4d63-4a39-be8d-a20aed178a11]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:39 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:39 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:39 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:40 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD Jun 15 07:34:40 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:40 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD" returned: 1 in 0.670s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:40 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] a73e7c84-77fd-470d-9604-abd42ed41469 was raw, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:34:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:40 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:40 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:41 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 0 in 1.118s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:41 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a73e7c84-77fd-470d-9604-abd42ed41469_r6jiw8judevstack@QuobyteHD, size 0.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:34:41 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:34:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:41 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1G Jun 15 07:34:41 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:42 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 1G" returned: 0 in 0.725s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:42 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f068e-36e5-451b-a0d1-6ece53a9fcf1]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:42 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:42 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:43 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 0 in 0.759s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:43 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:43 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:44 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 1 in 0.946s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Downloaded image a73e7c84-77fd-470d-9604-abd42ed41469 ((None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}])) to volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Temporary image a73e7c84-77fd-470d-9604-abd42ed41469 for user ee30cfccab26421e98a243bfdd4f9d9f is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Marking volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Copying metadata from image a73e7c84-77fd-470d-9604-abd42ed41469 to fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Creating volume glance metadata for volume fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 backed by image a73e7c84-77fd-470d-9604-abd42ed41469 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7c4048d8b72da848fe5e70f120d9bc53', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94a2403-369b-40b3-8526-7bf4ae0f4e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27', 'volume_size': 1, 'image_id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a73e7c84-77fd-470d-9604-abd42ed41469', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c4048d8b72da848fe5e70f120d9bc53', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '739141807a7d48698432d3c10b25066b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7918f53ebf968fa063c24fa5c1dd11a6f4098139ea0b4f4e5737ee12acdaa4416bec68c2130b92a322e63a48651ffb360c7058ee89ce1914e51278a915fdbbf0', 'id': 'a73e7c84-77fd-470d-9604-abd42ed41469', 'created_at': datetime.datetime(2026, 6, 15, 5, 34, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 34, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a73e7c84-77fd-470d-9604-abd42ed41469/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baad3df-d68e-4fdd-91ce-8cdd9f052ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Volume volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 (fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27): created successfully Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baad3df-d68e-4fdd-91ce-8cdd9f052ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Flow 'volume_create_manager' (3106ad20-0907-40b0-a0ad-840738d41a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-afc05690-981e-4728-b5b5-93c6621edfff tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Created volume successfully. Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Acquiring lock "cinder-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "cinder-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Acquiring lock "cinder-quobyte-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "cinder-quobyte-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb4324-7e43-4093-94cf-9b074e8c5c77]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:34:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:45 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:45 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:46 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:34:46 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:46 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 0 in 1.236s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:46 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:46 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:47 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.188s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:34:47 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 1 in 1.128s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:34:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:47 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27 Jun 15 07:34:47 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:48 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" returned: 0 in 0.722s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "cinder-quobyte-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27" released by "delete_volume" :: held 3.178s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:48 devstack cinder-volume[91865]: WARNING cinder.quota [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:34:48 devstack cinder-volume[91865]: WARNING cinder.quota [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Created reservations ['25df134b-a96f-4da1-a07c-14e29b2a80a1', 'aed46571-8565-48c4-b28e-f5e89f09dd71', '543e7f95-34e1-4328-ac38-0e0f60ead91c', '39a8d07b-158f-46a6-9de8-00ecc88714d5'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:48 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:34:48 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:49 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.701s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:49 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:34:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Deleted volume successfully. Jun 15 07:34:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ea3bbcf2-e69e-42df-97cb-552dd2d25f0b tempest-VolumeAndVolumeTypeFromImageTest-2080027876 None] Lock "cinder-fbe21d9b-f0a1-40e9-8ab6-daa1b4c8ff27-delete_volume" released by "delete_volume" :: held 4.192s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (14a5a767-78f1-4ac7-b252-8b63069a5749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf4fea2-dc20-4ac6-896e-eb0e7976642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf4fea2-dc20-4ac6-896e-eb0e7976642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034995438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187c7df-0bbd-4535-9336-da0d82d0e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:54Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c224d1ba-bc01-4cb4-af59-9f66707946ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c224d1ba-bc01-4cb4-af59-9f66707946ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf01468f-9f85-4116-8b29-5a7e35c8e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf01468f-9f85-4116-8b29-5a7e35c8e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4187c7df-0bbd-4535-9336-da0d82d0e9a3', 'volume_name': 'volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008361d0-bccc-4422-b284-23fee078d071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008361d0-bccc-4422-b284-23fee078d071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2e9a67-9338-4a9e-bc96-1accbdb797f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:53 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume 4187c7df-0bbd-4535-9336-da0d82d0e9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3', 'volume_size': 1} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034995438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4187c7df-0bbd-4535-9336-da0d82d0e9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:54Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Creating volume 4187c7df-0bbd-4535-9336-da0d82d0e9a3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:53 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:54 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 1073741824 Jun 15 07:34:54 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (1eaa0d0b-7099-4ba5-987f-ade6ae9200d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dd84c6-225b-4c70-a511-2b161842ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51dd84c6-225b-4c70-a511-2b161842ae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503634549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ccc799-21f0-4327-be91-2d6e03be7f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:54Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcedf957-93f4-4841-822d-d399d2a030c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcedf957-93f4-4841-822d-d399d2a030c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422bf32b-a676-4ea6-9da7-b24dabd91382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422bf32b-a676-4ea6-9da7-b24dabd91382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ccc799-21f0-4327-be91-2d6e03be7f4e', 'volume_name': 'volume-80ccc799-21f0-4327-be91-2d6e03be7f4e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e193d8-89d5-47e8-9479-dc3e6d4421bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e193d8-89d5-47e8-9479-dc3e6d4421bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3d871-9e69-4cd0-b6f8-42186653a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Volume 80ccc799-21f0-4327-be91-2d6e03be7f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ccc799-21f0-4327-be91-2d6e03be7f4e', 'volume_size': 1} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (be973ae7-56de-4487-81dd-db0f5b72b690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964fc402-a62d-43aa-84f8-d47161d9b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964fc402-a62d-43aa-84f8-d47161d9b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187803119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4bbd8-8cc9-466d-9af8-3ea2a220a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:55Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205d1224-11be-4441-8a6a-e50f0b4fc608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205d1224-11be-4441-8a6a-e50f0b4fc608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb336650-d3d0-4b1a-94e6-7f570cda2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb336650-d3d0-4b1a-94e6-7f570cda2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc4bbd8-8cc9-466d-9af8-3ea2a220a525', 'volume_name': 'volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740fa979-6ae1-47d9-a322-97b92b66aca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740fa979-6ae1-47d9-a322-97b92b66aca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35997aa9-4183-4df9-9c2f-c8185cd2e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:54 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Volume 1bc4bbd8-8cc9-466d-9af8-3ea2a220a525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525', 'volume_size': 1} Jun 15 07:34:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:55 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 1073741824" returned: 0 in 1.140s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:55 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 Jun 15 07:34:55 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (c9ea9221-ea00-422d-bc79-c5cdd35fd4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4815c253-bc38-4784-b7d5-43b7fc6eef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4815c253-bc38-4784-b7d5-43b7fc6eef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111612682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90375fa-5a01-47c1-85b9-e7308ee0cd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:55Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9c595d-12de-41c4-b4ca-db4bbbf8d202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9c595d-12de-41c4-b4ca-db4bbbf8d202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ac73da-c25d-43f7-a913-ebd50397721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ac73da-c25d-43f7-a913-ebd50397721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90375fa-5a01-47c1-85b9-e7308ee0cd5a', 'volume_name': 'volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4ba1e-17d9-4358-9d45-ed6b523b1655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d4ba1e-17d9-4358-9d45-ed6b523b1655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ec163c-ccd7-42d0-86f0-9020c8495825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Volume d90375fa-5a01-47c1-85b9-e7308ee0cd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a', 'volume_size': 1} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (4313603f-f50a-4bcf-97df-a3351c2784ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651cffa-5368-48be-b409-f1e3b8858ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b651cffa-5368-48be-b409-f1e3b8858ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111736233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725c3fbb-4a31-43fc-87e6-e86b7b438560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:56Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb07d6a-fcd6-43c2-a17c-919ed01aac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecb07d6a-fcd6-43c2-a17c-919ed01aac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688b148e-207f-430e-9482-43f453d5a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688b148e-207f-430e-9482-43f453d5a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725c3fbb-4a31-43fc-87e6-e86b7b438560', 'volume_name': 'volume-725c3fbb-4a31-43fc-87e6-e86b7b438560', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af50ada2-ca3d-43a4-bdff-615bc52570ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af50ada2-ca3d-43a4-bdff-615bc52570ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56935a-19a9-4578-9f6b-1201113480ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume 725c3fbb-4a31-43fc-87e6-e86b7b438560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725c3fbb-4a31-43fc-87e6-e86b7b438560', 'volume_size': 1} Jun 15 07:34:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:56 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3" returned: 0 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.078s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503634549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ccc799-21f0-4327-be91-2d6e03be7f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:54Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Creating volume 80ccc799-21f0-4327-be91-2d6e03be7f4e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:56 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e 1073741824 Jun 15 07:34:56 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f2e9a67-9338-4a9e-bc96-1accbdb797f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742aec2c-61f2-4e48-a6e0-5afb977eadcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:56 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 (4187c7df-0bbd-4535-9336-da0d82d0e9a3): created successfully Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742aec2c-61f2-4e48-a6e0-5afb977eadcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:56 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (14a5a767-78f1-4ac7-b252-8b63069a5749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3bea3d79-6026-4692-a892-ecc648ffd7a7 tempest-CreateVolumesFromImageTest-1161523437 None] Created volume successfully. Jun 15 07:34:57 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e 1073741824" returned: 0 in 0.975s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:57 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e Jun 15 07:34:57 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:57 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e" returned: 0 in 0.661s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187803119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc4bbd8-8cc9-466d-9af8-3ea2a220a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:55Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Creating volume 1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:57 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3d871-9e69-4cd0-b6f8-42186653a575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ccc799-21f0-4327-be91-2d6e03be7f4e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 1073741824 Jun 15 07:34:57 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de60c1e5-eee5-4791-a18d-b9fba71f02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:57 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Volume volume-80ccc799-21f0-4327-be91-2d6e03be7f4e (80ccc799-21f0-4327-be91-2d6e03be7f4e): created successfully Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de60c1e5-eee5-4791-a18d-b9fba71f02f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (1eaa0d0b-7099-4ba5-987f-ade6ae9200d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-84a5ff0f-6c4f-44df-9671-a3712728a056 tempest-CreateVolumesFromImageTest-1161523437 None] Created volume successfully. Jun 15 07:34:58 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 1073741824" returned: 0 in 0.938s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:58 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=42,cinder:UPDATE=52,cinder:INSERT=21,cinder:DELETE=4 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:34:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:58 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 Jun 15 07:34:58 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:59 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" returned: 0 in 0.695s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.964s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111612682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90375fa-5a01-47c1-85b9-e7308ee0cd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:55Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Creating volume d90375fa-5a01-47c1-85b9-e7308ee0cd5a {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:34:59 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35997aa9-4183-4df9-9c2f-c8185cd2e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:59 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a 1073741824 Jun 15 07:34:59 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48fd9f4-469f-4cb9-b55d-d41ee7852290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:34:59 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Volume volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 (1bc4bbd8-8cc9-466d-9af8-3ea2a220a525): created successfully Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48fd9f4-469f-4cb9-b55d-d41ee7852290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:34:59 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (be973ae7-56de-4487-81dd-db0f5b72b690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:34:59 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3b132902-ae1a-49f8-91b5-f6712214442d tempest-CreateVolumesFromImageTest-1161523437 None] Created volume successfully. Jun 15 07:35:00 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a 1073741824" returned: 0 in 0.818s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:00 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a Jun 15 07:35:00 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:00 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111736233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725c3fbb-4a31-43fc-87e6-e86b7b438560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8b7f8f06dc04c20b190963a0609ceef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:34:56Z,use_quota=True,user_id='b029edd37ab849d38d35e48e5aa3a917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Creating volume 725c3fbb-4a31-43fc-87e6-e86b7b438560 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:00 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:35:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:00 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 1073741824 Jun 15 07:35:00 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ec163c-ccd7-42d0-86f0-9020c8495825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa50726-d671-4126-9116-f31c53f657cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:01 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Volume volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a (d90375fa-5a01-47c1-85b9-e7308ee0cd5a): created successfully Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa50726-d671-4126-9116-f31c53f657cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (c9ea9221-ea00-422d-bc79-c5cdd35fd4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2f8dc5db-84a3-4136-93b3-eea08a50486c tempest-CreateVolumesFromImageTest-1161523437 None] Created volume successfully. Jun 15 07:35:01 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 1073741824" returned: 0 in 0.869s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:01 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 Jun 15 07:35:01 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:02 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560" returned: 0 in 0.634s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a56935a-19a9-4578-9f6b-1201113480ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725c3fbb-4a31-43fc-87e6-e86b7b438560', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbe51d4-4023-4bed-ab81-71f9aaaaeb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Volume volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 (725c3fbb-4a31-43fc-87e6-e86b7b438560): created successfully Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bbe51d4-4023-4bed-ab81-71f9aaaaeb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Flow 'volume_create_manager' (4313603f-f50a-4bcf-97df-a3351c2784ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:02 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b50a5f1f-1425-465c-b64d-1329f839dbc7 tempest-CreateVolumesFromImageTest-1161523437 None] Created volume successfully. Jun 15 07:35:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-725c3fbb-4a31-43fc-87e6-e86b7b438560-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-725c3fbb-4a31-43fc-87e6-e86b7b438560-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-quobyte-725c3fbb-4a31-43fc-87e6-e86b7b438560" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-725c3fbb-4a31-43fc-87e6-e86b7b438560" acquired by "delete_volume" :: waited 0.079s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4315f48-abdf-4969-a2d7-b076fa07716c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:04 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 Jun 15 07:35:04 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:04 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560" returned: 0 in 0.963s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:05 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560 Jun 15 07:35:05 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:05 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-725c3fbb-4a31-43fc-87e6-e86b7b438560" returned: 0 in 0.650s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-725c3fbb-4a31-43fc-87e6-e86b7b438560" released by "delete_volume" :: held 1.714s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Created reservations ['e7948ead-767e-4115-b91b-daa761401bec', 'ef856a22-a77a-4740-970d-23f8f90b68ee', '59066060-aaa1-4c4b-925b-b4897b14a3b6', '4782e228-2aad-4d89-adb7-7537f5c93f2e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:05 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:05 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-d90375fa-5a01-47c1-85b9-e7308ee0cd5a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-d90375fa-5a01-47c1-85b9-e7308ee0cd5a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-quobyte-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b49e359-2a48-4376-8842-0c7f0403a9d5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:06 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a Jun 15 07:35:06 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:06 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Deleted volume successfully. Jun 15 07:35:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08deb2e6-50f5-4b43-ae33-4a3e9d4534b9 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-725c3fbb-4a31-43fc-87e6-e86b7b438560-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:07 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" returned: 0 in 0.940s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:07 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a Jun 15 07:35:07 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:08 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-d90375fa-5a01-47c1-85b9-e7308ee0cd5a" released by "delete_volume" :: held 1.815s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Created reservations ['7a2d24ad-78c6-458e-9078-fbce803a1e3b', '90aff415-23a6-49d3-b8bc-3685f3896107', 'a0ff55cf-af57-49b2-aebd-1763633c8c65', '9474d824-01cd-4d4d-bd60-5d3c7b33d398'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:08 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-quobyte-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" acquired by "delete_volume" :: waited 0.044s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[78720bf7-5e7d-40b6-b61b-bc54581e24b3]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Flow 'volume_create_manager' (90fa469a-6dda-42fd-bc7b-29f5686cdf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdcc523-b4e7-4bf0-9660-aba5b56db15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdcc523-b4e7-4bf0-9660-aba5b56db15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1285396633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b35e3eb-c9b7-4abb-976a-bceec15bc1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3d6001ab84ec3b455597c7845a990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:09Z,use_quota=True,user_id='5227a82f4c2947dfa24727c54128cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7795950-8b6b-4795-8256-fb122da5c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7795950-8b6b-4795-8256-fb122da5c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef403a0-a57e-457c-8804-0915e0b3053c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:08 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 Jun 15 07:35:08 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef403a0-a57e-457c-8804-0915e0b3053c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b35e3eb-c9b7-4abb-976a-bceec15bc1cd', 'volume_name': 'volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a566c1-5210-4cdd-96b4-e37159713615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a566c1-5210-4cdd-96b4-e37159713615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412ebc2-38c6-458c-b58c-f6949de6ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Volume 9b35e3eb-c9b7-4abb-976a-bceec15bc1cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd', 'volume_size': 1} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1285396633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b35e3eb-c9b7-4abb-976a-bceec15bc1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0d3d6001ab84ec3b455597c7845a990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:35:09Z,use_quota=True,user_id='5227a82f4c2947dfa24727c54128cd22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Creating volume 9b35e3eb-c9b7-4abb-976a-bceec15bc1cd {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:35:08 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:35:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:08 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd 1073741824 Jun 15 07:35:08 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:09 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.767s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Deleted volume successfully. Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-442bcfa1-71fe-43a5-ab6b-a5d3ef1382d6 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-d90375fa-5a01-47c1-85b9-e7308ee0cd5a-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:09 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" returned: 0 in 0.798s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:09 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525 Jun 15 07:35:09 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:09 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd 1073741824" returned: 0 in 0.936s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:09 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd Jun 15 07:35:09 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:10 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525" released by "delete_volume" :: held 1.574s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Created reservations ['520ee194-978e-4441-842d-bccf487bb29f', 'b4418a15-eb7d-4cce-897c-d8e88b7afa90', 'bc71c910-196a-4a35-98f7-517da8454438', 'ff885d2e-caaf-46d8-a367-e25f0e75c8f2'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:10 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:10 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:10 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" returned: 0 in 0.670s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1412ebc2-38c6-458c-b58c-f6949de6ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aa3051-fbd5-4787-b1a6-c0538a656542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:35:10 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Volume volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd (9b35e3eb-c9b7-4abb-976a-bceec15bc1cd): created successfully Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aa3051-fbd5-4787-b1a6-c0538a656542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Flow 'volume_create_manager' (90fa469a-6dda-42fd-bc7b-29f5686cdf56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:35:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a534f546-c633-4409-af07-d1a9f187576d tempest-TestMinimumBasicScenario-654628249 None] Created volume successfully. Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-80ccc799-21f0-4327-be91-2d6e03be7f4e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-80ccc799-21f0-4327-be91-2d6e03be7f4e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-quobyte-80ccc799-21f0-4327-be91-2d6e03be7f4e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-80ccc799-21f0-4327-be91-2d6e03be7f4e" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[88037d64-361d-4aa8-b00a-5beb342a4fb3]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.810s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Deleted volume successfully. Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9bfc16-39e4-424d-bf6f-75e7babec6c7]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8669f726-35c0-4ec9-9571-ec5d6fbf3d44 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-1bc4bbd8-8cc9-466d-9af8-3ea2a220a525-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:11 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e Jun 15 07:35:11 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f Jun 15 07:35:11 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:11 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e" returned: 0 in 0.870s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:12 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e Jun 15 07:35:12 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:12 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f" returned: 0 in 0.803s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-23e6553b-1692-4e06-baeb-916b02e5a60f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a294f692-5d52-49e7-88d3-a0a5d037978a', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:35:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-89accf63-7f12-447a-8225-602a1fcbf828 req-7ffe885c-57c7-48e1-97e7-e68da64e844b tempest-TestServerVolumeAttachmentScenario-526712532 None] attachment_update completed successfully. Jun 15 07:35:12 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-80ccc799-21f0-4327-be91-2d6e03be7f4e" returned: 0 in 0.695s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-80ccc799-21f0-4327-be91-2d6e03be7f4e" released by "delete_volume" :: held 1.633s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Created reservations ['68071dc0-9de7-4b27-8ac2-c849bd7a7e43', '0db51f5f-903d-4580-a305-e62c41251586', '9c0de0a0-b816-4a6a-9b9a-724cf2fe8a99', 'c1c07407-a79a-4a18-8dbd-75e6938cfdfe'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:12 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:12 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-4187c7df-0bbd-4535-9336-da0d82d0e9a3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-4187c7df-0bbd-4535-9336-da0d82d0e9a3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=78,cinder:INSERT=25,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "cinder-quobyte-4187c7df-0bbd-4535-9336-da0d82d0e9a3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-4187c7df-0bbd-4535-9336-da0d82d0e9a3" acquired by "delete_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d329387-a9f8-43b0-81a3-aed22c5dba74]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:13 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 Jun 15 07:35:13 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:13 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.825s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Deleted volume successfully. Jun 15 07:35:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0f3051de-980a-4b56-a479-ca3a181d3960 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-80ccc799-21f0-4327-be91-2d6e03be7f4e-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:14 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3" returned: 0 in 0.846s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:14 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3 Jun 15 07:35:14 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551c139-5d4d-4ed4-9ad4-dbb7227bdd77]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:14 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd Jun 15 07:35:14 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:15 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4187c7df-0bbd-4535-9336-da0d82d0e9a3" returned: 0 in 0.748s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-quobyte-4187c7df-0bbd-4535-9336-da0d82d0e9a3" released by "delete_volume" :: held 1.676s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Created reservations ['17fed69b-f3d7-4fb6-9764-2ef1ac680b42', '74b7ef43-f723-4cb0-8764-2361c53a6905', '4ab67984-4c5c-4dd5-8272-8f23e3e8769e', '892bdaae-9380-4669-b2e1-2a3175b860d6'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:15 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:15 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:15 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" returned: 0 in 0.829s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.874s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a70cd87-4886-44df-8103-338bcef57ff9', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:35:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-828a18bb-7353-4fce-b89d-c892a565aee4 req-e5998534-cb30-4844-8034-30e1fa460e6f tempest-TestMinimumBasicScenario-654628249 None] attachment_update completed successfully. Jun 15 07:35:15 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.737s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:15 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Deleted volume successfully. Jun 15 07:35:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5fa668fb-a4d9-4ff1-a2ec-087915b09996 tempest-CreateVolumesFromImageTest-1161523437 None] Lock "cinder-4187c7df-0bbd-4535-9336-da0d82d0e9a3-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d5130-262f-4a17-8c5e-7e0eca8dd9aa]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:22 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 Jun 15 07:35:22 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:23 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171" returned: 0 in 0.974s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-da26659d-62f3-4307-8613-db09a5614171', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '959409e2-599e-4cc0-a52a-1072d245e247', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:35:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-2f079267-9436-4680-8f05-84a74d32b232 req-9573ff53-399a-4dff-be58-0bfa0dcbdc87 tempest-TestServerVolumeAttachmentScenario-526712532 None] attachment_update completed successfully. Jun 15 07:35:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-eb956402-f474-4eec-94f6-cf0c99d23d21 req-c6788393-e8e7-4f3d-bbc8-5a2cc63897be tempest-TestServerVolumeAttachmentScenario-526712532 None] Terminate volume connection completed successfully. Jun 15 07:35:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-eb956402-f474-4eec-94f6-cf0c99d23d21 req-c6788393-e8e7-4f3d-bbc8-5a2cc63897be tempest-TestServerVolumeAttachmentScenario-526712532 None] Deleting attachment 959409e2-599e-4cc0-a52a-1072d245e247. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:35:33 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=48,cinder:SELECT=46,cinder:INSERT=7,cinder:DELETE=4 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-d190c2cc-ff3e-4a59-bbe8-2a8484c67d6c req-28c951a3-b05b-4956-aac7-016f7ed202b0 tempest-TestServerVolumeAttachmentScenario-526712532 None] Terminate volume connection completed successfully. Jun 15 07:35:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-d190c2cc-ff3e-4a59-bbe8-2a8484c67d6c req-28c951a3-b05b-4956-aac7-016f7ed202b0 tempest-TestServerVolumeAttachmentScenario-526712532 None] Deleting attachment a294f692-5d52-49e7-88d3-a0a5d037978a. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:35:43 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "cinder-da26659d-62f3-4307-8613-db09a5614171-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-da26659d-62f3-4307-8613-db09a5614171-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "cinder-quobyte-da26659d-62f3-4307-8613-db09a5614171" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-quobyte-da26659d-62f3-4307-8613-db09a5614171" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00ae14-c0da-46f1-8323-7e924a00b1c9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:44 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 Jun 15 07:35:44 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:45 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:45 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171 Jun 15 07:35:45 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:45 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-da26659d-62f3-4307-8613-db09a5614171" returned: 0 in 0.614s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-quobyte-da26659d-62f3-4307-8613-db09a5614171" released by "delete_volume" :: held 1.366s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Created reservations ['2a3758b4-e991-4244-903d-b2bdf4feed89', '59217525-c01e-4711-89d9-0fd5e265f996', '7c3fecd6-4842-4530-90fa-5721bf3254b4', '8e0107e4-269c-4fd2-9997-3c293fe10cc0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:46 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:46 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:46 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.580s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Deleted volume successfully. Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "cinder-23e6553b-1692-4e06-baeb-916b02e5a60f-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:46 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:46 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-23e6553b-1692-4e06-baeb-916b02e5a60f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ee618461-8f81-4378-b4c9-b8b7817c4e82 tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-da26659d-62f3-4307-8613-db09a5614171-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "cinder-quobyte-23e6553b-1692-4e06-baeb-916b02e5a60f" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-quobyte-23e6553b-1692-4e06-baeb-916b02e5a60f" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[911ad9bd-4c64-41c4-b21d-c608e7fc149d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:35:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:46 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f Jun 15 07:35:46 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:47 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:35:47 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f" returned: 0 in 0.719s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:47 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f Jun 15 07:35:47 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:48 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-23e6553b-1692-4e06-baeb-916b02e5a60f" returned: 0 in 0.580s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-quobyte-23e6553b-1692-4e06-baeb-916b02e5a60f" released by "delete_volume" :: held 1.342s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Created reservations ['3e3532c0-f26f-49ab-a5af-028f495ece7e', '45116f2a-bd54-4abf-bfcd-05d863d8a7ce', '79ace668-7e3b-4598-8c71-50f25c56f504', 'ef35c83a-329d-4281-966e-63b53dcf5653'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:35:48 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:35:48 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:35:48 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.589s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:35:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Deleted volume successfully. Jun 15 07:35:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2bc749fd-27f9-40e3-bd1b-b2199cf5b2df tempest-TestServerVolumeAttachmentScenario-526712532 None] Lock "cinder-23e6553b-1692-4e06-baeb-916b02e5a60f-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:35:58 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=7,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-2f234812-bcc6-4b84-9f7c-102d6cfa236c req-32af1dc0-c352-40f4-8e9d-188f1ca6e6c1 tempest-TestMinimumBasicScenario-654628249 None] Terminate volume connection completed successfully. Jun 15 07:36:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-2f234812-bcc6-4b84-9f7c-102d6cfa236c req-32af1dc0-c352-40f4-8e9d-188f1ca6e6c1 tempest-TestMinimumBasicScenario-654628249 None] Deleting attachment 7a70cd87-4886-44df-8103-338bcef57ff9. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:36:08 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "cinder-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "cinder-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "cinder-quobyte-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "cinder-quobyte-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5b9a82-5800-4c3e-9611-3c6452bcf396]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:10 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd Jun 15 07:36:10 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:10 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" returned: 0 in 0.705s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:10 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd Jun 15 07:36:10 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:11 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" returned: 0 in 0.625s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "cinder-quobyte-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd" released by "delete_volume" :: held 1.375s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Created reservations ['c97b47a1-4e67-436c-be13-6fa499e19fbc', '5ce18f78-8899-4b4a-bf76-c096ea3646d4', '6b73d499-e39b-4a1c-a6ec-f5c56a66cfad', 'a1f8b480-6e66-4f6f-a726-94b78cc43d74'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:11 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:36:11 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:12 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.799s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:12 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Deleted volume successfully. Jun 15 07:36:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d44f0a37-1285-4332-a299-6afd234802ef tempest-TestMinimumBasicScenario-654628249 None] Lock "cinder-9b35e3eb-c9b7-4abb-976a-bceec15bc1cd-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Flow 'volume_create_manager' (06c36eee-cf98-4e24-99a9-418443762c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca985921-796d-4bef-b190-4cb6d81984eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca985921-796d-4bef-b190-4cb6d81984eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-420444004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f337ec4-3bb1-42cf-bc53-e481a251cff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3da90c34c4b0293f36088223990e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:20Z,use_quota=True,user_id='92a64e1544644249b2e6a2376d807eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a51118-54cc-441e-b60e-fc21b6013c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a51118-54cc-441e-b60e-fc21b6013c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c37fe6-0abe-4b5a-aa5a-36d16281f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c37fe6-0abe-4b5a-aa5a-36d16281f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'volume_name': 'volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325829eb-51da-47f7-b3cb-0e421938f6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325829eb-51da-47f7-b3cb-0e421938f6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b2fa73-073b-4963-bd0c-a9ea89183ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:20 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Trying to clone 3f337ec4-3bb1-42cf-bc53-e481a251cff3 from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c at location (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:36:20 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:36:20 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Image download 20.69 MB at 20.69 MB/s Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe86bf1f-51bd-4f90-8b1a-4776c9b4a607]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:21 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD Jun 15 07:36:21 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:21 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c is fetched for user 92a64e1544644249b2e6a2376d807eec. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a112fc3c-ad56-479e-b211-655473e3f9da]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:21 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD Jun 15 07:36:21 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:22 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD" returned: 0 in 0.726s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-420444004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f337ec4-3bb1-42cf-bc53-e481a251cff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0be3da90c34c4b0293f36088223990e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:20Z,use_quota=True,user_id='92a64e1544644249b2e6a2376d807eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Creating volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:22 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:36:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:22 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1073741824 Jun 15 07:36:22 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:23 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1073741824" returned: 0 in 0.914s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:23 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:23 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:24 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.635s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Attempting download of 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3343bc4-c9f6-44fa-8137-01a270d52ff4]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:24 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w Jun 15 07:36:24 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:24 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w" returned: 0 in 0.703s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:25 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w Jun 15 07:36:25 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:25 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w" returned: 1 in 0.749s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_uyi4ps9w' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d250bcb-0a2a-46b6-9b82-4c8d75ed75ea]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:25 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD Jun 15 07:36:25 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:26 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD" returned: 0 in 0.725s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:26 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c was qcow2, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:36:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:26 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:26 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:28 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 2.067s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:28 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c_wulb8020devstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:36:28 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Converted 112.00 MB image at 54.15 MB/s Jun 15 07:36:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:28 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1G Jun 15 07:36:28 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 1G" returned: 0 in 0.681s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7cc74-108e-48ab-8af6-4a546dcd12ab]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:29 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:29 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:29 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.756s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:30 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:30 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:30 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 1 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Downloaded image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c ((None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}])) to volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Temporary image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c for user 92a64e1544644249b2e6a2376d807eec is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Marking volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Copying metadata from image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c to 3f337ec4-3bb1-42cf-bc53-e481a251cff3. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Creating volume glance metadata for volume 3f337ec4-3bb1-42cf-bc53-e481a251cff3 backed by image 579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b2fa73-073b-4963-bd0c-a9ea89183ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'volume_size': 1, 'image_id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b77a84c7443943f09e4b1b8aebccceed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c', 'created_at': datetime.datetime(2026, 6, 15, 5, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 13, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/579f516d-f5b4-4aa8-9f7e-5dbaa7bf780c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec236690-f878-4b01-a9f2-4adc611cac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Volume volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 (3f337ec4-3bb1-42cf-bc53-e481a251cff3): created successfully Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec236690-f878-4b01-a9f2-4adc611cac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Flow 'volume_create_manager' (06c36eee-cf98-4e24-99a9-418443762c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-46b48c7f-6983-4c7f-ac0f-a64b4b0fca75 tempest-TestShelveInstance-384434354 None] Created volume successfully. Jun 15 07:36:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:39 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[229ea16e-da6e-4947-b805-14b46d89697d]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:36:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:39 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:39 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:40 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.833s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:40 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:36:40 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:41 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 1 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:36:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.692s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:41 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aab768d-4911-463d-b42d-1e03f48c240b', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:36:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-e8bcbd9a-e02d-40fc-ad4a-3419d6d5d64a req-5fc48e27-2b94-4a97-9b2e-c8ef358cd4e8 tempest-TestShelveInstance-384434354 None] attachment_update completed successfully. Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:46 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:36:46 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:47 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.178s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:36:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:36:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:36:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:36:51 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:51 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=18,cinder:INSERT=8,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Flow 'volume_create_manager' (0427f0fe-91ab-4ead-8313-8ae5318ef329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9389a98-90a8-4cbb-acec-5b5d70c68611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9389a98-90a8-4cbb-acec-5b5d70c68611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1214708274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f319dd-8cb9-4def-87a6-041a474b767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba603564b8d14f0b9183b9db2b70c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:53Z,use_quota=True,user_id='d921372f71114d29924a3eb17730aa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c01885-f831-434c-8e6e-c7fa1190be76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c01885-f831-434c-8e6e-c7fa1190be76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bfb322-f037-4c3d-8f58-76f253b16229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64bfb322-f037-4c3d-8f58-76f253b16229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f319dd-8cb9-4def-87a6-041a474b767c', 'volume_name': 'volume-67f319dd-8cb9-4def-87a6-041a474b767c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7386f4-e57c-4900-93e1-83f8b7309541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e7386f4-e57c-4900-93e1-83f8b7309541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdef7b0-6663-41c1-b50e-04b2fd76c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:53 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Volume 67f319dd-8cb9-4def-87a6-041a474b767c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f319dd-8cb9-4def-87a6-041a474b767c', 'volume_size': 1} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1214708274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f319dd-8cb9-4def-87a6-041a474b767c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba603564b8d14f0b9183b9db2b70c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:36:53Z,use_quota=True,user_id='d921372f71114d29924a3eb17730aa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Creating volume 67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:36:53 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:36:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:53 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c 1073741824 Jun 15 07:36:53 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:54 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c 1073741824" returned: 0 in 1.153s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:36:54 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:36:54 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:36:55 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.775s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bdef7b0-6663-41c1-b50e-04b2fd76c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f319dd-8cb9-4def-87a6-041a474b767c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa2a7f-e41c-45cf-a98d-1814a63eaabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:36:55 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Volume volume-67f319dd-8cb9-4def-87a6-041a474b767c (67f319dd-8cb9-4def-87a6-041a474b767c): created successfully Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60aa2a7f-e41c-45cf-a98d-1814a63eaabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:36:55 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Flow 'volume_create_manager' (0427f0fe-91ab-4ead-8313-8ae5318ef329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:36:55 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-62938a19-4df2-44e6-b305-6fa0e9e967e7 tempest-TestStampPattern-539489254 None] Created volume successfully. Jun 15 07:37:05 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:37:05 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:37:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-89576648-e030-4795-bfdf-9f18d8b8ac87 req-6e51c2c4-6097-4b19-bdac-cb926b8f18ee tempest-TestShelveInstance-384434354 None] Terminate volume connection completed successfully. Jun 15 07:37:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-89576648-e030-4795-bfdf-9f18d8b8ac87 req-6e51c2c4-6097-4b19-bdac-cb926b8f18ee tempest-TestShelveInstance-384434354 None] Deleting attachment 1aab768d-4911-463d-b42d-1e03f48c240b. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:37:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d163e7-fa3d-4199-a602-be7259c2eee5]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:26 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:37:26 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:27 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.781s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:27 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:37:27 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:27 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 1 in 0.779s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.609s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '070fae27-5dd9-42f9-9ccf-98fd76607bb8', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:37:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-6dea08f7-e400-4565-8702-33b17fbe3d37 req-4942bdf1-30d4-4f84-b173-f3c60dd90e82 tempest-TestShelveInstance-384434354 None] attachment_update completed successfully. Jun 15 07:37:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:34 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[14099e53-6752-4c48-a501-4d973b257761]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:34 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:37:34 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:35 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.777s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-67f319dd-8cb9-4def-87a6-041a474b767c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73efd018-87a4-409c-89f9-230cd08440dc', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:37:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-71428548-b926-4e12-af01-68a5cadeb228 req-d57aa309-e943-475b-94c8-ba41f82e3674 tempest-TestStampPattern-539489254 None] attachment_update completed successfully. Jun 15 07:37:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-b25ff6c1-10a1-4b4e-bdcf-811767d02f6b req-409968c0-9517-41bc-a679-0a540ddca4ab tempest-TestStampPattern-539489254 None] Terminate volume connection completed successfully. Jun 15 07:37:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-b25ff6c1-10a1-4b4e-bdcf-811767d02f6b req-409968c0-9517-41bc-a679-0a540ddca4ab tempest-TestStampPattern-539489254 None] Deleting attachment 73efd018-87a4-409c-89f9-230cd08440dc. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Creating offline snapshot 42743f39-b302-4393-be47-b421eda1c94e of volume 67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6719fd-7988-440b-80b3-9755d696a1ae]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:46 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:37:46 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:46 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:37:46 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:47 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.805s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:47 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e 1G Jun 15 07:37:47 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:47 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.703s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:37:47 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e 1G" returned: 0 in 0.777s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f319dd-8cb9-4def-87a6-041a474b767c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:47 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f319dd-8cb9-4def-87a6-041a474b767c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:37:47 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:48 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67f319dd-8cb9-4def-87a6-041a474b767c -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.619s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:48 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e is being set with open permissions: ugo+rw Jun 15 07:37:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:48 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:37:48 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:49 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.613s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:49 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info Jun 15 07:37:49 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:49 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info" returned: 0 in 0.592s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:49 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info is being set with open permissions: ugo+rw Jun 15 07:37:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:37:49 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info Jun 15 07:37:49 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:37:50 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Jun 15 07:37:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.info" returned: 0 in 0.589s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:37:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.098s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:37:50 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0ad5968d-cbeb-4451-a651-f1aedb7e1f88 tempest-TestStampPattern-539489254 None] Create snapshot completed successfully Jun 15 07:38:00 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Flow 'volume_create_manager' (216bc50c-fe79-48bf-bff9-e2a0f9437758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9572201d-2976-40b9-b85e-e577bf1bfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9572201d-2976-40b9-b85e-e577bf1bfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-292470717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7478e420-f295-4ffc-b2d4-ad02b9c58d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba603564b8d14f0b9183b9db2b70c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=42743f39-b302-4393-be47-b421eda1c94e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:01Z,use_quota=True,user_id='d921372f71114d29924a3eb17730aa66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7419df-4612-4fd4-8f25-3f2fc2fe91a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7419df-4612-4fd4-8f25-3f2fc2fe91a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2059bb-3e34-4857-93cb-e7cd925b2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2059bb-3e34-4857-93cb-e7cd925b2c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7478e420-f295-4ffc-b2d4-ad02b9c58d1a', 'volume_name': 'volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a', 'volume_size': 1, 'snapshot_id': '42743f39-b302-4393-be47-b421eda1c94e'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d847fd6f-5cf8-4a0d-b64c-004441e51a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d847fd6f-5cf8-4a0d-b64c-004441e51a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b42ef-5636-4330-8c39-e8bcb45011cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:01 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Volume 7478e420-f295-4ffc-b2d4-ad02b9c58d1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a', 'volume_size': 1, 'snapshot_id': '42743f39-b302-4393-be47-b421eda1c94e'} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Creating volume 7478e420-f295-4ffc-b2d4-ad02b9c58d1a from snapshot 42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] snapshot: 42743f39-b302-4393-be47-b421eda1c94e, volume: 7478e420-f295-4ffc-b2d4-ad02b9c58d1a, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36078f-4631-4c43-a234-5a227f05c646]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:01 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:38:01 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:02 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.796s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f319dd-8cb9-4def-87a6-041a474b767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b2328-fa48-414f-b107-0b81d06c6b22]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:02 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:38:02 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:02 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.776s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:03 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:38:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:03 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a Jun 15 07:38:03 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-0919b159-87e6-4319-a98c-675a48c09337 req-8af2c814-10e4-4ac4-9702-fc254029de75 tempest-TestShelveInstance-384434354 None] Terminate volume connection completed successfully. Jun 15 07:38:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-0919b159-87e6-4319-a98c-675a48c09337 req-8af2c814-10e4-4ac4-9702-fc254029de75 tempest-TestShelveInstance-384434354 None] Deleting attachment 070fae27-5dd9-42f9-9ccf-98fd76607bb8. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:38:09 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" returned: 0 in 6.649s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f56bf-a4f9-4645-8d4d-69adb0172420]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:09 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:38:09 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:10 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.995s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:10 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:38:10 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Converted 1024.00 MB image at 153.99 MB/s Jun 15 07:38:10 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a is being set with open permissions: ugo+rw Jun 15 07:38:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:10 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a Jun 15 07:38:10 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:10 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Acquiring lock "cinder-3f337ec4-3bb1-42cf-bc53-e481a251cff3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "cinder-3f337ec4-3bb1-42cf-bc53-e481a251cff3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Acquiring lock "cinder-quobyte-3f337ec4-3bb1-42cf-bc53-e481a251cff3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "cinder-quobyte-3f337ec4-3bb1-42cf-bc53-e481a251cff3" acquired by "delete_volume" :: waited 0.036s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c45ea3b-1dd5-4ed2-9b86-338b3bf36fef]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:11 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:38:11 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:11 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" returned: 0 in 0.661s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" released by "_copy_volume_from_snapshot" :: held 9.983s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" released by "_create_volume_from_snapshot" :: held 10.021s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.037s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093b42ef-5636-4330-8c39-e8bcb45011cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a', 'volume_size': 1, 'snapshot_id': '42743f39-b302-4393-be47-b421eda1c94e'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec9aac-e0aa-4540-9a57-460de5e69065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:11 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Volume volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a (7478e420-f295-4ffc-b2d4-ad02b9c58d1a): created successfully Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec9aac-e0aa-4540-9a57-460de5e69065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Flow 'volume_create_manager' (216bc50c-fe79-48bf-bff9-e2a0f9437758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e5294a50-3b81-4afa-9117-0df6ae9e9d4e tempest-TestStampPattern-539489254 None] Created volume successfully. Jun 15 07:38:12 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.911s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:12 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:38:12 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:12 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 1 in 0.709s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:38:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:12 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3 Jun 15 07:38:12 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:13 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3f337ec4-3bb1-42cf-bc53-e481a251cff3" returned: 0 in 0.610s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "cinder-quobyte-3f337ec4-3bb1-42cf-bc53-e481a251cff3" released by "delete_volume" :: held 2.331s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG cinder.quota [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Created reservations ['4af4e961-a506-4a20-8695-8e7e9fe912c2', '2614a0d7-674b-476e-ac10-6562f9e8cb72', '828683a3-3ba0-44e2-9fe9-ca1293ee8e34', 'ca0afae5-e8ce-4d08-82b3-76f161d2262d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:13 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:13 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:14 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.633s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:14 devstack cinder-volume[91865]: DEBUG cinder.manager [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Deleted volume successfully. Jun 15 07:38:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [req-0919b159-87e6-4319-a98c-675a48c09337 req-850819af-14e1-4143-92c2-3d8e8d752780 tempest-TestShelveInstance-384434354 None] Lock "cinder-3f337ec4-3bb1-42cf-bc53-e481a251cff3-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:23 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:38:24 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (7016cedb-bb3d-4ac1-bd77-5cb3127349c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c484cf2-324c-403d-9c98-a1ef69b06c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c484cf2-324c-403d-9c98-a1ef69b06c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259790949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f8b369-1dd3-4ebe-8530-e4c2d1d18b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:26Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9410fae3-a5e9-473a-b87e-2ab6876520ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9410fae3-a5e9-473a-b87e-2ab6876520ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacde120-d6b3-4a12-aed6-f000b6b97cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacde120-d6b3-4a12-aed6-f000b6b97cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f8b369-1dd3-4ebe-8530-e4c2d1d18b15', 'volume_name': 'volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fbfb95-e712-4343-b033-32ef91d6bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fbfb95-e712-4343-b033-32ef91d6bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678aa1bb-4fc2-4fae-96d9-736c01e97ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:26 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume 13f8b369-1dd3-4ebe-8530-e4c2d1d18b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15', 'volume_size': 1} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1259790949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f8b369-1dd3-4ebe-8530-e4c2d1d18b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:26Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume 13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:26 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:26 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 1073741824 Jun 15 07:38:26 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:27 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 1073741824" returned: 0 in 0.945s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:27 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 Jun 15 07:38:27 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:27 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" returned: 0 in 0.624s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678aa1bb-4fc2-4fae-96d9-736c01e97ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e630d22-92aa-4738-b28f-6f8f295f5edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:27 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 (13f8b369-1dd3-4ebe-8530-e4c2d1d18b15): created successfully Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e630d22-92aa-4738-b28f-6f8f295f5edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:27 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (7016cedb-bb3d-4ac1-bd77-5cb3127349c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a2841f73-1a47-4896-a0fd-8e6e10d7f3d5 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating offline snapshot 7d5d0e81-1b06-4c16-9068-d2c511be1f7e of volume 13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:38:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a00533-28cd-4045-84d4-da78e8db7217]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:28 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 Jun 15 07:38:28 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:29 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" returned: 0 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:29 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e 1G Jun 15 07:38:29 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:30 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e 1G" returned: 0 in 0.783s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:30 devstack sudo[109654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e Jun 15 07:38:30 devstack sudo[109654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:30 devstack sudo[109654]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e" returned: 0 in 0.615s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:30 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e is being set with open permissions: ugo+rw Jun 15 07:38:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:30 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e Jun 15 07:38:30 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:31 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e" returned: 0 in 0.590s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:31 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info Jun 15 07:38:31 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:31 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info" returned: 0 in 0.621s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:31 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info is being set with open permissions: ugo+rw Jun 15 07:38:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:31 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info Jun 15 07:38:31 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:32 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.info" returned: 0 in 0.613s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5fb1b96a-8144-4208-8cdc-8a2e5e25e414 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Create snapshot completed successfully Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (3a77f7aa-c1c3-4435-98fb-53d4cd89b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2f397d-9f16-4935-a208-e9573402ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2f397d-9f16-4935-a208-e9573402ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640555939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4771f47-89ad-4dd7-b28b-2c152404efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:33Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247b18de-ec35-4d49-aa36-b1cdf67679c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247b18de-ec35-4d49-aa36-b1cdf67679c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a1ef93-e1e2-4ae6-8c9b-c885db8cd9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a1ef93-e1e2-4ae6-8c9b-c885db8cd9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4771f47-89ad-4dd7-b28b-2c152404efcb', 'volume_name': 'volume-d4771f47-89ad-4dd7-b28b-2c152404efcb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621d60-bfa6-4948-8613-07ba11cf9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621d60-bfa6-4948-8613-07ba11cf9973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cfe423-7e0a-4067-9621-e2152dfcffe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume d4771f47-89ad-4dd7-b28b-2c152404efcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4771f47-89ad-4dd7-b28b-2c152404efcb', 'volume_size': 1} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640555939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4771f47-89ad-4dd7-b28b-2c152404efcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:33Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume d4771f47-89ad-4dd7-b28b-2c152404efcb {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:33 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:33 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb 1073741824 Jun 15 07:38:33 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (d265617c-5bb0-4923-9a74-50633fcb2abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5769028-1176-433d-bae5-fcf951cda09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5769028-1176-433d-bae5-fcf951cda09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767697256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5863141-f303-463a-bcd7-55ec73463dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:33Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9603c436-a3d3-41b4-890f-8ab73a9ca528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9603c436-a3d3-41b4-890f-8ab73a9ca528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b8a9ba-2fcd-4943-95b2-02833626b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b8a9ba-2fcd-4943-95b2-02833626b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5863141-f303-463a-bcd7-55ec73463dd0', 'volume_name': 'volume-d5863141-f303-463a-bcd7-55ec73463dd0', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc1f317-6956-456a-890f-957bb7555058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc1f317-6956-456a-890f-957bb7555058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926a3649-5c63-4e85-bd9c-d157c0978625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume d5863141-f303-463a-bcd7-55ec73463dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5863141-f303-463a-bcd7-55ec73463dd0', 'volume_size': 1} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (1ab8e159-0c5a-46cd-8beb-6e32f83290d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0541a7f7-5923-4422-9551-7944313ac09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0541a7f7-5923-4422-9551-7944313ac09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193651235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e14d27-2607-497a-8834-c63ead81cb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b202192d-55bc-4d89-b53a-36fd87185971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b202192d-55bc-4d89-b53a-36fd87185971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42d3b7d-6521-44f1-9796-d95f95c5a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42d3b7d-6521-44f1-9796-d95f95c5a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e14d27-2607-497a-8834-c63ead81cb79', 'volume_name': 'volume-a4e14d27-2607-497a-8834-c63ead81cb79', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7789d118-5d6a-4693-ac9c-c60c540329d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7789d118-5d6a-4693-ac9c-c60c540329d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb50dfb-1fd3-4c20-a50e-4c8a53b38879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume a4e14d27-2607-497a-8834-c63ead81cb79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e14d27-2607-497a-8834-c63ead81cb79', 'volume_size': 1} Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:33 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb 1073741824" returned: 0 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:34 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb Jun 15 07:38:34 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (fe4337fb-c8b7-4db8-aa09-3722164cf912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1daf1-4dd2-4c6b-bb40-3ddb484da284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b1daf1-4dd2-4c6b-bb40-3ddb484da284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543926881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f78661-0659-468a-82b9-5027c74fa901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148780c8-553c-4ac4-aa4a-8418a977c09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148780c8-553c-4ac4-aa4a-8418a977c09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee071188-c0ac-41c1-9685-0235db7c0172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee071188-c0ac-41c1-9685-0235db7c0172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f78661-0659-468a-82b9-5027c74fa901', 'volume_name': 'volume-e6f78661-0659-468a-82b9-5027c74fa901', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6b91b-c886-4bbd-ace8-87eb01a702de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6b91b-c886-4bbd-ace8-87eb01a702de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843e57b1-57fe-4a06-b096-71dfebaea4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume e6f78661-0659-468a-82b9-5027c74fa901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f78661-0659-468a-82b9-5027c74fa901', 'volume_size': 1} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (ef5bc4ef-4b0f-4350-bc63-40d690bb48ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b4442a-b061-43b8-abcd-5da3eddad225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b4442a-b061-43b8-abcd-5da3eddad225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162838589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc65388-d5bd-4016-a3fd-696464b29337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2406129a-5b3a-4f4e-96a8-0a4d106f37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2406129a-5b3a-4f4e-96a8-0a4d106f37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc30b86-8c0d-4ca6-a89d-d3cd9929a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fc30b86-8c0d-4ca6-a89d-d3cd9929a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc65388-d5bd-4016-a3fd-696464b29337', 'volume_name': 'volume-8fc65388-d5bd-4016-a3fd-696464b29337', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31e5e5-7828-4294-a47f-48f5d349258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df31e5e5-7828-4294-a47f-48f5d349258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17a2691-3ebf-4e1a-b5fe-d311044daa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume 8fc65388-d5bd-4016-a3fd-696464b29337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc65388-d5bd-4016-a3fd-696464b29337', 'volume_size': 1} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:34 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb" returned: 0 in 0.640s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.208s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-767697256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5863141-f303-463a-bcd7-55ec73463dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:33Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume d5863141-f303-463a-bcd7-55ec73463dd0 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:34 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cfe423-7e0a-4067-9621-e2152dfcffe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4771f47-89ad-4dd7-b28b-2c152404efcb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 1073741824 Jun 15 07:38:34 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6f365c-0730-46f9-901c-a7e42704f600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:34 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-d4771f47-89ad-4dd7-b28b-2c152404efcb (d4771f47-89ad-4dd7-b28b-2c152404efcb): created successfully Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6f365c-0730-46f9-901c-a7e42704f600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:34 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (3a77f7aa-c1c3-4435-98fb-53d4cd89b911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-51c4fb2c-416f-4ae2-b4ff-03e473c0c52b tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:35 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 1073741824" returned: 0 in 0.778s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:35 devstack sudo[109690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 Jun 15 07:38:35 devstack sudo[109690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:36 devstack sudo[109690]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0" returned: 0 in 0.599s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-193651235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e14d27-2607-497a-8834-c63ead81cb79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume a4e14d27-2607-497a-8834-c63ead81cb79 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:36 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:36 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 1073741824 Jun 15 07:38:36 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926a3649-5c63-4e85-bd9c-d157c0978625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5863141-f303-463a-bcd7-55ec73463dd0', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e343a1-d2c9-4377-844f-821aef1a577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:36 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-d5863141-f303-463a-bcd7-55ec73463dd0 (d5863141-f303-463a-bcd7-55ec73463dd0): created successfully Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e343a1-d2c9-4377-844f-821aef1a577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (d265617c-5bb0-4923-9a74-50633fcb2abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5a174db3-90d8-497b-90e4-37ff81550182 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:36 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 1073741824" returned: 0 in 0.771s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:36 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 Jun 15 07:38:36 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:37 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79" returned: 0 in 0.581s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543926881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f78661-0659-468a-82b9-5027c74fa901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume e6f78661-0659-468a-82b9-5027c74fa901 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:37 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:37 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 1073741824 Jun 15 07:38:37 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb50dfb-1fd3-4c20-a50e-4c8a53b38879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e14d27-2607-497a-8834-c63ead81cb79', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13ff177-4d1f-4311-9be3-2e229c723f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-a4e14d27-2607-497a-8834-c63ead81cb79 (a4e14d27-2607-497a-8834-c63ead81cb79): created successfully Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13ff177-4d1f-4311-9be3-2e229c723f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (1ab8e159-0c5a-46cd-8beb-6e32f83290d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f86f9f6e-3201-4da8-96af-1314acc6c11c tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:38 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 1073741824" returned: 0 in 0.735s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:38 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 Jun 15 07:38:38 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:38 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.357s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-162838589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc65388-d5bd-4016-a3fd-696464b29337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de4e8336e584ff3b25a1421b21ebd0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:38:34Z,use_quota=True,user_id='dcfa1e613d334ccbae713823abfe1d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Creating volume 8fc65388-d5bd-4016-a3fd-696464b29337 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:38:38 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:38 devstack sudo[109709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 1073741824 Jun 15 07:38:38 devstack sudo[109709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843e57b1-57fe-4a06-b096-71dfebaea4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f78661-0659-468a-82b9-5027c74fa901', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae44b7d-1cfe-4986-a9ba-d0b09c06ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:38 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-e6f78661-0659-468a-82b9-5027c74fa901 (e6f78661-0659-468a-82b9-5027c74fa901): created successfully Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae44b7d-1cfe-4986-a9ba-d0b09c06ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (fe4337fb-c8b7-4db8-aa09-3722164cf912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-af3c35a4-e65b-431c-bf09-146ca0733f20 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:39 devstack sudo[109709]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 1073741824" returned: 0 in 0.776s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:39 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 Jun 15 07:38:39 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:40 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337" returned: 0 in 0.609s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17a2691-3ebf-4e1a-b5fe-d311044daa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc65388-d5bd-4016-a3fd-696464b29337', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a34e03-87d6-4561-a66b-5a54419db9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:38:40 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Volume volume-8fc65388-d5bd-4016-a3fd-696464b29337 (8fc65388-d5bd-4016-a3fd-696464b29337): created successfully Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a34e03-87d6-4561-a66b-5a54419db9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:38:40 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Flow 'volume_create_manager' (ef5bc4ef-4b0f-4350-bc63-40d690bb48ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:38:40 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-04a4494d-8b64-4d2b-8327-893b42a9fdb6 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created volume successfully. Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-8fc65388-d5bd-4016-a3fd-696464b29337-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-8fc65388-d5bd-4016-a3fd-696464b29337-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-8fc65388-d5bd-4016-a3fd-696464b29337" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-8fc65388-d5bd-4016-a3fd-696464b29337" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ffa187-c9e6-4021-a8b4-8af979988f4a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:41 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 Jun 15 07:38:41 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:41 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:41 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337 Jun 15 07:38:41 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:42 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8fc65388-d5bd-4016-a3fd-696464b29337" returned: 0 in 0.578s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-8fc65388-d5bd-4016-a3fd-696464b29337" released by "delete_volume" :: held 1.357s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['e2c82fd7-9e03-4cf5-ac44-b651f49ed145', 'b47db6d9-49de-4a6d-91d1-b530faf106fc', '43903527-d036-4dbe-a480-f6cada0c6966', 'c37af029-29a5-4566-8512-1359a222910c'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:42 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:42 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:43 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.634s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-9ae642ad-adde-4877-8ff8-15c99b4a0163 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-8fc65388-d5bd-4016-a3fd-696464b29337-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-e6f78661-0659-468a-82b9-5027c74fa901-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-e6f78661-0659-468a-82b9-5027c74fa901-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-e6f78661-0659-468a-82b9-5027c74fa901" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-e6f78661-0659-468a-82b9-5027c74fa901" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd39cca6-150d-4d6e-8b19-9c9a5614532e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:43 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 Jun 15 07:38:43 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:44 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901" returned: 0 in 0.709s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:44 devstack sudo[109733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901 Jun 15 07:38:44 devstack sudo[109733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:44 devstack sudo[109733]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-e6f78661-0659-468a-82b9-5027c74fa901" returned: 0 in 0.581s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-e6f78661-0659-468a-82b9-5027c74fa901" released by "delete_volume" :: held 1.331s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['6c851e7a-3bcc-457e-ab52-c68393127dde', '01105242-2efb-4c4e-a73d-2b28e93c63ce', '74e5f7e4-30e3-41c4-8759-6b7a7edd48cf', '3e9910ae-6386-48ab-9624-a429a474011d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:44 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:44 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:45 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.572s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cbcf805b-fb97-4347-8d98-37f75091118d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-e6f78661-0659-468a-82b9-5027c74fa901-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-a4e14d27-2607-497a-8834-c63ead81cb79-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-a4e14d27-2607-497a-8834-c63ead81cb79-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-a4e14d27-2607-497a-8834-c63ead81cb79" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-a4e14d27-2607-497a-8834-c63ead81cb79" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ab1dc-2215-4ea0-8ef0-c163dd94a3e1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:45 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 Jun 15 07:38:45 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:46 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79" returned: 0 in 0.678s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:46 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79 Jun 15 07:38:46 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:46 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:46 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:46 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-a4e14d27-2607-497a-8834-c63ead81cb79" returned: 0 in 0.595s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-a4e14d27-2607-497a-8834-c63ead81cb79" released by "delete_volume" :: held 1.317s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:46 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['17c7d96f-6620-431e-ad83-7dc8b3c9cd80', '568daa92-f154-4a11-ba21-fe18f6bb87b3', '33a6b1a9-339a-46c0-9cca-266775862c55', '9894920d-c18e-407b-b807-42d7137fa49b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:47 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:47 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:47 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.601s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:38:47 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.580s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:47 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c4946c22-481f-4624-ae55-23f1eacfbb4e tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-a4e14d27-2607-497a-8834-c63ead81cb79-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-d5863141-f303-463a-bcd7-55ec73463dd0-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-d5863141-f303-463a-bcd7-55ec73463dd0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-d5863141-f303-463a-bcd7-55ec73463dd0" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-d5863141-f303-463a-bcd7-55ec73463dd0" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d194475-3080-43f7-b09a-014151acc6a0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:47 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 Jun 15 07:38:47 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:48 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0" returned: 0 in 0.674s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:48 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0 Jun 15 07:38:48 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:49 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5863141-f303-463a-bcd7-55ec73463dd0" returned: 0 in 0.571s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-d5863141-f303-463a-bcd7-55ec73463dd0" released by "delete_volume" :: held 1.281s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['786ba37c-a803-4ca7-858e-2a950ff62528', 'bf8b694d-929b-4582-9d9a-aa12f3b9d5a1', '44454400-c84a-48c5-9e3b-e2ca19f3384c', '4426f7b8-f2d0-4c66-aeb5-b123a35522a4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:49 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:49 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:49 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.558s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-a636ca83-aa16-4928-bc1e-beaeca30ed3d tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-d5863141-f303-463a-bcd7-55ec73463dd0-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-d4771f47-89ad-4dd7-b28b-2c152404efcb-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:49 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-d4771f47-89ad-4dd7-b28b-2c152404efcb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-d4771f47-89ad-4dd7-b28b-2c152404efcb" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-d4771f47-89ad-4dd7-b28b-2c152404efcb" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27dfeb9-800b-4bfc-8a3b-ee322c3c87e3]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:50 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb Jun 15 07:38:50 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:50 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb" returned: 0 in 0.680s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:50 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb Jun 15 07:38:50 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:51 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d4771f47-89ad-4dd7-b28b-2c152404efcb" returned: 0 in 0.589s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-d4771f47-89ad-4dd7-b28b-2c152404efcb" released by "delete_volume" :: held 1.305s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['954c3cb8-a0c1-457c-b193-786525c2fb6a', 'ae5b5a72-51c8-487b-b068-7d363485172d', 'e4b12314-4ca3-4ee1-8b2c-d65c9b6bcb99', 'ee10749d-0c97-4c03-8db4-1815b49d753e'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:51 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:51 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:52 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.576s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:52 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6e9dc56a-ebd8-46a7-8e58-454907379345 tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-d4771f47-89ad-4dd7-b28b-2c152404efcb-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-7d5d0e81-1b06-4c16-9068-d2c511be1f7e-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-7d5d0e81-1b06-4c16-9068-d2c511be1f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" acquired by "delete_snapshot" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-7d5d0e81-1b06-4c16-9068-d2c511be1f7e" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-7d5d0e81-1b06-4c16-9068-d2c511be1f7e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleting offline snapshot 7d5d0e81-1b06-4c16-9068-d2c511be1f7e of volume 13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] snapshot_file for this snap is: volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab36c2-0e7f-4314-beae-31a334c808cb]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:52 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e Jun 15 07:38:52 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:52 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e" returned: 0 in 0.706s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9cbe7b-426e-45d2-b2b4-3902abbcdd34]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:53 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 Jun 15 07:38:53 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:53 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:53 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e Jun 15 07:38:53 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:54 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e" returned: 0 in 0.670s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:54 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e Jun 15 07:38:54 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:54 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15.7d5d0e81-1b06-4c16-9068-d2c511be1f7e" returned: 0 in 0.576s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-7d5d0e81-1b06-4c16-9068-d2c511be1f7e" released by "_delete_snapshot" :: held 2.736s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" released by "delete_snapshot" :: held 2.757s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:54 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['09af899f-e787-4227-860b-3959dd5bf0f7', 'b8f9bf8b-dfaa-4ee5-89d9-be6f46b59991', 'bce40d35-1ccd-48de-a12e-5ca7c790c638', '751c6244-5c93-4e99-b622-5492854d6448'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:55 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Delete snapshot completed successfully. Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3672ba98-c3a0-4edf-a09e-764fb041e4bb tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-7d5d0e81-1b06-4c16-9068-d2c511be1f7e-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d72e738-d523-4c5f-8faa-33b63b0ee9b5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:38:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:55 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 Jun 15 07:38:55 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:56 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" returned: 0 in 0.693s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:56 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15 Jun 15 07:38:56 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:56 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" returned: 0 in 0.587s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-quobyte-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15" released by "delete_volume" :: held 1.341s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Created reservations ['f1026344-4004-4069-8200-ec8735585f73', 'bb22b994-4b23-419d-8ebf-d810bf304941', '7ec5a02d-97b9-444e-b884-e12bd048c00d', 'fad6d194-0447-4255-b84e-7bfe31febdfc'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:38:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:38:56 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:38:56 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:38:57 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Jun 15 07:38:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.566s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:38:57 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:38:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Deleted volume successfully. Jun 15 07:38:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-07c22ed2-96ff-4b19-896a-2ed9bce0934f tempest-CreateVolumesFromSnapshotTest-1069945755 None] Lock "cinder-13f8b369-1dd3-4ebe-8530-e4c2d1d18b15-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c2d25-75be-4874-87d5-995c76d346b1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:01 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a Jun 15 07:39:01 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:01 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" returned: 0 in 0.693s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.711s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d', 'name': 'volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6864b72-ff57-4e18-af85-936ab0ae1be2', 'enforce_multipath': True} {{(pid=91865) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 15 07:39:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-652d0d7a-a2b5-4ea4-8988-1c491a9c5719 req-19ad09dd-382a-487f-b529-3d4a66e3f9b7 tempest-TestStampPattern-539489254 None] attachment_update completed successfully. Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Flow 'volume_create_manager' (ffc5a291-c8b6-46a6-a004-67998dc6b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44106274-c35a-494e-8e9d-92d9dc8f5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44106274-c35a-494e-8e9d-92d9dc8f5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8d2f54-ba17-4836-a623-bc2b4525fd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0223131ced044db3a52d15345f8d31f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:02Z,use_quota=True,user_id='6d44bba0fd8b437fadd97c682d4b0b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6f5ed8-82a7-4c8d-8934-266ea65eb43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6f5ed8-82a7-4c8d-8934-266ea65eb43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72030279-c43e-4081-81b3-ab9ae0657e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72030279-c43e-4081-81b3-ab9ae0657e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ec8d2f54-ba17-4836-a623-bc2b4525fd35', 'volume_name': 'volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35', 'volume_size': 1, 'image_id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d6051c777ad887d70feb67dab5bdff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0223131ced044db3a52d15345f8d31f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba70c62741a0965769e9c21751ba57430499935a96609e7a91ba52cf0be34d9168fe9ba1c200a21b0345312e1f45723e0767071e32f614519f2481010dd1d3f', 'id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'created_at': datetime.datetime(2026, 6, 15, 5, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08d9005-a404-4ae7-a065-075bcc695456/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fbd6e-e2a1-440f-bd16-2ff783ae8e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559fbd6e-e2a1-440f-bd16-2ff783ae8e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2806c-056d-4ea4-b79a-5dd00129a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:02 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Volume ec8d2f54-ba17-4836-a623-bc2b4525fd35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35', 'volume_size': 1, 'image_id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d6051c777ad887d70feb67dab5bdff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0223131ced044db3a52d15345f8d31f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba70c62741a0965769e9c21751ba57430499935a96609e7a91ba52cf0be34d9168fe9ba1c200a21b0345312e1f45723e0767071e32f614519f2481010dd1d3f', 'id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'created_at': datetime.datetime(2026, 6, 15, 5, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08d9005-a404-4ae7-a065-075bcc695456/file', 'properties': {}}, 'image_service': } Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Trying to clone ec8d2f54-ba17-4836-a623-bc2b4525fd35 from image e08d9005-a404-4ae7-a065-075bcc695456 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:39:02 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[683bf4e1-55ba-4291-9225-aff3f630418b]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:02 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:02 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:03 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:03 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:03 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:04 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 1 in 0.642s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Temporary image e08d9005-a404-4ae7-a065-075bcc695456 is fetched for user 6d44bba0fd8b437fadd97c682d4b0b4c. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac971d-3a44-425a-9bc4-46bf074418a0]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:04 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:04 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:04 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 0 in 0.646s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:04 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:04 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:05 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 1 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8d2f54-ba17-4836-a623-bc2b4525fd35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0223131ced044db3a52d15345f8d31f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:02Z,use_quota=True,user_id='6d44bba0fd8b437fadd97c682d4b0b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Creating volume ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:39:05 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:39:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:05 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1073741824 Jun 15 07:39:05 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:06 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1073741824" returned: 0 in 0.718s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:06 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:06 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:06 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 0 in 0.583s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Attempting download of e08d9005-a404-4ae7-a065-075bcc695456 ((None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}])) to volume ec8d2f54-ba17-4836-a623-bc2b4525fd35. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432b9ce-65bf-4302-b59e-460f41adc8c5]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:06 devstack sudo[110285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk Jun 15 07:39:06 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:07 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk" returned: 0 in 0.697s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:07 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk Jun 15 07:39:07 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:08 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk" returned: 1 in 0.657s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e08d9005-a404-4ae7-a065-075bcc695456_azbwcwvk' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709aa71-0db0-4f8a-8652-5aa02167d228]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:08 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:08 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:08 devstack cinder-volume[91865]: INFO cinder.volume.manager [req-b0c82986-0757-4077-9049-ec2c3d854885 req-ab800d6a-e5e4-421c-85ba-c2713071f0e4 tempest-TestStampPattern-539489254 None] Terminate volume connection completed successfully. Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [req-b0c82986-0757-4077-9049-ec2c3d854885 req-ab800d6a-e5e4-421c-85ba-c2713071f0e4 tempest-TestStampPattern-539489254 None] Deleting attachment e6864b72-ff57-4e18-af85-936ab0ae1be2. {{(pid=91865) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 15 07:39:08 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:09 devstack sudo[110329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD Jun 15 07:39:09 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:09 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD" returned: 1 in 0.659s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:09 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] e08d9005-a404-4ae7-a065-075bcc695456 was raw, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:39:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:09 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:09 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:10 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 0 in 0.651s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e08d9005-a404-4ae7-a065-075bcc695456_a6zmjxkkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:39:10 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:10 devstack sudo[110340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1G Jun 15 07:39:10 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:10 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 1G" returned: 0 in 0.646s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d752e-2619-4d05-8647-d469e709ebe5]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:11 devstack sudo[110349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:11 devstack sudo[110349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:11 devstack sudo[110349]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 0 in 0.792s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:11 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:11 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:12 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 1 in 0.793s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Downloaded image e08d9005-a404-4ae7-a065-075bcc695456 ((None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}])) to volume ec8d2f54-ba17-4836-a623-bc2b4525fd35 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Temporary image e08d9005-a404-4ae7-a065-075bcc695456 for user 6d44bba0fd8b437fadd97c682d4b0b4c is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Marking volume ec8d2f54-ba17-4836-a623-bc2b4525fd35 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Copying metadata from image e08d9005-a404-4ae7-a065-075bcc695456 to ec8d2f54-ba17-4836-a623-bc2b4525fd35. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Creating volume glance metadata for volume ec8d2f54-ba17-4836-a623-bc2b4525fd35 backed by image e08d9005-a404-4ae7-a065-075bcc695456 with: {'image_id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '26d6051c777ad887d70feb67dab5bdff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a2806c-056d-4ea4-b79a-5dd00129a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35', 'volume_size': 1, 'image_id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e08d9005-a404-4ae7-a065-075bcc695456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d6051c777ad887d70feb67dab5bdff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0223131ced044db3a52d15345f8d31f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eba70c62741a0965769e9c21751ba57430499935a96609e7a91ba52cf0be34d9168fe9ba1c200a21b0345312e1f45723e0767071e32f614519f2481010dd1d3f', 'id': 'e08d9005-a404-4ae7-a065-075bcc695456', 'created_at': datetime.datetime(2026, 6, 15, 5, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 39, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e08d9005-a404-4ae7-a065-075bcc695456/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da5bc4e-1000-4a4b-aa61-fab36b84b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Volume volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 (ec8d2f54-ba17-4836-a623-bc2b4525fd35): created successfully Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da5bc4e-1000-4a4b-aa61-fab36b84b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Flow 'volume_create_manager' (ffc5a291-c8b6-46a6-a004-67998dc6b179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-23fcaa5f-b3cd-4582-85ee-1d23442cdb94 tempest-VolumeImageDependencyTests-917676224 None] Created volume successfully. Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Acquiring lock "cinder-ec8d2f54-ba17-4836-a623-bc2b4525fd35-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:12 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "cinder-ec8d2f54-ba17-4836-a623-bc2b4525fd35-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Acquiring lock "cinder-quobyte-ec8d2f54-ba17-4836-a623-bc2b4525fd35" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "cinder-quobyte-ec8d2f54-ba17-4836-a623-bc2b4525fd35" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f60d63-97a0-4c63-8519-d2114aa019e8]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:13 devstack sudo[110402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:13 devstack sudo[110402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:13 devstack sudo[110402]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 0 in 0.745s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:13 devstack sudo[110407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:13 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:14 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 1 in 0.737s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:39:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:14 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35 Jun 15 07:39:14 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:15 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ec8d2f54-ba17-4836-a623-bc2b4525fd35" returned: 0 in 0.583s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "cinder-quobyte-ec8d2f54-ba17-4836-a623-bc2b4525fd35" released by "delete_volume" :: held 2.130s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Created reservations ['d6a4974a-eaf5-4b85-88e5-27c6eb5b7456', '5f1d2c07-b6f8-46a4-83d8-053c0ba8915f', '2ccbd30a-84d3-482c-985a-19765a7cf83b', '4e743d7c-5da6-4c05-9de6-f9194a376ec0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:15 devstack sudo[110417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:15 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:15 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.586s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Deleted volume successfully. Jun 15 07:39:15 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-57621f98-14b1-4409-a201-d40a2b69c1d8 tempest-VolumeImageDependencyTests-917676224 None] Lock "cinder-ec8d2f54-ba17-4836-a623-bc2b4525fd35-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-7478e420-f295-4ffc-b2d4-ad02b9c58d1a-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "cinder-7478e420-f295-4ffc-b2d4-ad02b9c58d1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" acquired by "delete_volume" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:18 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d1a3f-9580-44c1-a0ab-24b06d3cc9f8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:18 devstack sudo[110420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a Jun 15 07:39:18 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:18 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" returned: 0 in 0.726s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:18 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a Jun 15 07:39:18 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Flow 'volume_create_manager' (ef4219ed-cb1b-472b-90a9-4f4a2f0ab443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d7b106-c8a5-471b-b855-61ae87dbc3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d7b106-c8a5-471b-b855-61ae87dbc3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce681586-28f2-4dcb-9891-3fa4eb193822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bcdae847444dd38c857ddd9186797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:19Z,use_quota=True,user_id='0eb28895284f4e30bce97abe270c3a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2915bc-0be8-4889-a55e-eb28495ded73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc2915bc-0be8-4889-a55e-eb28495ded73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8682cb-fcbd-435e-822d-7d09a1966d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8682cb-fcbd-435e-822d-7d09a1966d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce681586-28f2-4dcb-9891-3fa4eb193822', 'volume_name': 'volume-ce681586-28f2-4dcb-9891-3fa4eb193822', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d319bb0-0cff-4300-9a28-b2da865427f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d319bb0-0cff-4300-9a28-b2da865427f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c1ff90-9142-47ab-916b-f211ba72e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:19 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Volume ce681586-28f2-4dcb-9891-3fa4eb193822: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce681586-28f2-4dcb-9891-3fa4eb193822', 'volume_size': 1} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce681586-28f2-4dcb-9891-3fa4eb193822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bcdae847444dd38c857ddd9186797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:19Z,use_quota=True,user_id='0eb28895284f4e30bce97abe270c3a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Creating volume ce681586-28f2-4dcb-9891-3fa4eb193822 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:39:19 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:19 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 1073741824 Jun 15 07:39:19 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:19 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" returned: 0 in 0.626s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-7478e420-f295-4ffc-b2d4-ad02b9c58d1a" released by "delete_volume" :: held 1.401s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Created reservations ['092e9cf7-70d5-41e5-94a1-bccf9129d5a5', '84992e3b-70d5-482b-b619-6995f1ddc4ed', '48788fee-07f9-428d-9ed8-80c0a57273fd', 'd970d580-b793-4273-8bcf-a041233ec1b4'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:19 devstack sudo[110431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:19 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:19 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 1073741824" returned: 0 in 0.773s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:20 devstack sudo[110437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 Jun 15 07:39:20 devstack sudo[110437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:20 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Deleted volume successfully. Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c970516-df3d-40d8-8845-59d70f1fee4d tempest-TestStampPattern-539489254 None] Lock "cinder-7478e420-f295-4ffc-b2d4-ad02b9c58d1a-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-42743f39-b302-4393-be47-b421eda1c94e-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-42743f39-b302-4393-be47-b421eda1c94e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Deleting offline snapshot 42743f39-b302-4393-be47-b421eda1c94e of volume 67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] snapshot_file for this snap is: volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a7320-da69-4faf-b42d-130e90afb147]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:20 devstack sudo[110437]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822" returned: 0 in 0.602s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:39:20 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:39:20 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c1ff90-9142-47ab-916b-f211ba72e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce681586-28f2-4dcb-9891-3fa4eb193822', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cca32ce-7194-4aa7-9e80-b7e7af093c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:20 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Volume volume-ce681586-28f2-4dcb-9891-3fa4eb193822 (ce681586-28f2-4dcb-9891-3fa4eb193822): created successfully Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cca32ce-7194-4aa7-9e80-b7e7af093c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:20 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Flow 'volume_create_manager' (ef4219ed-cb1b-472b-90a9-4f4a2f0ab443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-89bca0ce-50f8-4be1-8e45-3aadb4aee3d7 tempest-CinderUnicodeTest-800784758 None] Created volume successfully. Jun 15 07:39:21 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.669s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67f319dd-8cb9-4def-87a6-041a474b767c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cce699-a29a-45e4-967c-15f647969b6e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:21 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:39:21 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Flow 'volume_create_manager' (44e42f47-2785-4015-9c37-c6f013141f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f6f6b-a6ef-4358-aaed-86b2d7006321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504f6f6b-a6ef-4358-aaed-86b2d7006321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-155472229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19c6a66-7a2c-42d7-a671-c463f4830ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bcdae847444dd38c857ddd9186797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:22Z,use_quota=True,user_id='0eb28895284f4e30bce97abe270c3a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd699c2c-3282-4cdf-b5c7-e24b94bf9400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd699c2c-3282-4cdf-b5c7-e24b94bf9400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fef4ec-bd9a-4c44-87c7-88273530f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fef4ec-bd9a-4c44-87c7-88273530f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19c6a66-7a2c-42d7-a671-c463f4830ec4', 'volume_name': 'volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7100a06-ce38-481c-98d1-3646a0be83ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7100a06-ce38-481c-98d1-3646a0be83ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c840227-be36-482d-9e3f-8041a74ecc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:21 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Volume b19c6a66-7a2c-42d7-a671-c463f4830ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4', 'volume_size': 1} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-155472229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19c6a66-7a2c-42d7-a671-c463f4830ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bcdae847444dd38c857ddd9186797e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:22Z,use_quota=True,user_id='0eb28895284f4e30bce97abe270c3a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Creating volume b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:39:21 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:21 devstack sudo[110449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 1073741824 Jun 15 07:39:21 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:21 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.745s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:21 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:39:21 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:22 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 1073741824" returned: 0 in 0.788s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:22 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 Jun 15 07:39:22 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:22 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.732s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:22 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e Jun 15 07:39:22 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:23 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4" returned: 0 in 0.600s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c840227-be36-482d-9e3f-8041a74ecc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1086142-5697-4f1f-96bf-ec0856924576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:23 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c.42743f39-b302-4393-be47-b421eda1c94e" returned: 0 in 0.572s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:23 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Volume volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 (b19c6a66-7a2c-42d7-a671-c463f4830ec4): created successfully Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1086142-5697-4f1f-96bf-ec0856924576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Flow 'volume_create_manager' (44e42f47-2785-4015-9c37-c6f013141f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-42743f39-b302-4393-be47-b421eda1c94e" released by "_delete_snapshot" :: held 2.832s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1615a5c2-fa15-41df-ab26-671f4275f0cf tempest-CinderUnicodeTest-800784758 None] Created volume successfully. Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" released by "delete_snapshot" :: held 2.857s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Created reservations ['b01d7635-945a-4b5c-a0c9-0cce72d48f7d', 'ea2fdf66-f53a-463e-a622-6e847fbe8b82', '53578a8c-e33c-4d97-9b33-8234eb17af23', 'd33aeeea-73bd-4de6-98fe-0212a7675ff3'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Delete snapshot completed successfully. Jun 15 07:39:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8cf332a2-6d32-4014-86cb-ce5738efa250 tempest-TestStampPattern-539489254 None] Lock "cinder-42743f39-b302-4393-be47-b421eda1c94e-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=101,cinder:UPDATE=99,cinder:INSERT=29,cinder:DELETE=11 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Creating offline snapshot ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 of volume b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebdc8e0-160a-499d-bd3e-7d29e801ed36]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:24 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 Jun 15 07:39:24 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:24 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4" returned: 0 in 0.749s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:24 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 1G Jun 15 07:39:24 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:25 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 1G" returned: 0 in 0.855s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:25 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 Jun 15 07:39:25 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:26 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:26 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 is being set with open permissions: ugo+rw Jun 15 07:39:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:26 devstack sudo[110526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 Jun 15 07:39:26 devstack sudo[110526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:26 devstack sudo[110526]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" returned: 0 in 0.574s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:26 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=71,cinder:INSERT=30,cinder:UPDATE=115,cinder:DELETE=7 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:39:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:27 devstack sudo[110529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info Jun 15 07:39:27 devstack sudo[110529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:27 devstack sudo[110529]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info" returned: 0 in 0.658s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:27 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info is being set with open permissions: ugo+rw Jun 15 07:39:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:27 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info Jun 15 07:39:27 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:28 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.info" returned: 0 in 0.578s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.199s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b7c465a0-ac46-4e21-84ae-e694e98ae0a1 tempest-CinderUnicodeTest-800784758 None] Create snapshot completed successfully Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-quobyte-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Deleting offline snapshot ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 of volume b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] snapshot_file for this snap is: volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b754666-91f0-476b-b58a-c01a27d1c351]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:29 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 Jun 15 07:39:29 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:30 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6d4dc-08be-4b5d-9fba-d180835af4d3]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:30 devstack sudo[110541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 Jun 15 07:39:30 devstack sudo[110541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-67f319dd-8cb9-4def-87a6-041a474b767c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "cinder-67f319dd-8cb9-4def-87a6-041a474b767c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Acquiring lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e189ab-a2ba-41ba-96ae-44b9d36b4598]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:30 devstack sudo[110541]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4" returned: 0 in 0.719s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:30 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 Jun 15 07:39:30 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:30 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:39:30 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:31 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:31 devstack sudo[110556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c Jun 15 07:39:31 devstack sudo[110556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:31 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" returned: 0 in 0.688s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:31 devstack sudo[110558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4 Jun 15 07:39:31 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:31 devstack sudo[110556]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-67f319dd-8cb9-4def-87a6-041a474b767c" returned: 0 in 0.568s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "cinder-quobyte-67f319dd-8cb9-4def-87a6-041a474b767c" released by "delete_volume" :: held 1.303s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Created reservations ['7a5cee4a-f6d6-4b87-83d7-621d175398ba', '559b65f5-ec68-4521-90d0-5af259e0f0bd', 'f20c0860-5cf9-4e54-b2d8-9c304a2b9dd2', 'a318978c-375b-4193-b634-6171dba92dbd'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:32 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4.ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" returned: 0 in 0.613s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:32 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:32 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4" released by "_delete_snapshot" :: held 2.839s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" released by "delete_snapshot" :: held 2.861s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Created reservations ['13a8d7fa-41b0-4db6-bbed-229878737b34', '7f8137ec-9012-4a6a-b598-f3e34c423e84', 'e1ebabbe-d1e0-4552-8fdc-75d80a5a5ab6', '3e20e4cc-140e-4abf-823a-b922ed587040'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Delete snapshot completed successfully. Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-73d9df30-b016-43af-b8b8-1b7932206abf tempest-CinderUnicodeTest-800784758 None] Lock "cinder-ca6cc31e-e16b-4edd-80a6-0c7f43f03ae4-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-b19c6a66-7a2c-42d7-a671-c463f4830ec4-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "cinder-b19c6a66-7a2c-42d7-a671-c463f4830ec4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[12293de6-bbae-4665-b608-2344617eefd9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:32 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 Jun 15 07:39:32 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:32 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.586s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Deleted volume successfully. Jun 15 07:39:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6d87e34b-282c-44df-84b0-c9d01344bb6a tempest-TestStampPattern-539489254 None] Lock "cinder-67f319dd-8cb9-4def-87a6-041a474b767c-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:33 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:33 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4 Jun 15 07:39:33 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:33 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b19c6a66-7a2c-42d7-a671-c463f4830ec4" returned: 0 in 0.636s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-b19c6a66-7a2c-42d7-a671-c463f4830ec4" released by "delete_volume" :: held 1.441s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Created reservations ['87250faf-b75c-412f-90ce-ab0eabe7a18c', '521b2723-29df-4a91-a946-e36f4172ff63', 'bcf040e6-b6ae-4d0e-8282-5567d7237d9d', '56a5e27d-903e-4c57-a6e5-731144ef1089'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:34 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:34 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-ce681586-28f2-4dcb-9891-3fa4eb193822-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:34 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.640s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "cinder-ce681586-28f2-4dcb-9891-3fa4eb193822-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:34 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Deleted volume successfully. Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-dec12fed-1432-4943-b40d-07c326c269cd tempest-CinderUnicodeTest-800784758 None] Lock "cinder-b19c6a66-7a2c-42d7-a671-c463f4830ec4-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Acquiring lock "cinder-quobyte-ce681586-28f2-4dcb-9891-3fa4eb193822" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-ce681586-28f2-4dcb-9891-3fa4eb193822" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01971d2-51e6-42c4-8c86-31fbdf9b3dc5]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:34 devstack sudo[110585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 Jun 15 07:39:34 devstack sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:35 devstack sudo[110585]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822" returned: 0 in 0.725s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:35 devstack sudo[110590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822 Jun 15 07:39:35 devstack sudo[110590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:36 devstack sudo[110590]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-ce681586-28f2-4dcb-9891-3fa4eb193822" returned: 0 in 0.631s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "cinder-quobyte-ce681586-28f2-4dcb-9891-3fa4eb193822" released by "delete_volume" :: held 1.400s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Created reservations ['7bc3932c-b3cf-4cbf-8b8f-1b93ba75b36b', 'b89a9721-3b71-4a52-aaed-dbaad379cd10', 'd04bf6db-c38f-4176-b8af-724a45862ca9', 'e896b40b-0e17-49f1-a650-200ccc1d52f2'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:36 devstack sudo[110593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:36 devstack sudo[110593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:36 devstack sudo[110593]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.652s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:36 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Deleted volume successfully. Jun 15 07:39:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d72cc2d8-67c7-4bbb-b786-b9ca3b6a97ce tempest-CinderUnicodeTest-800784758 None] Lock "cinder-ce681586-28f2-4dcb-9891-3fa4eb193822-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Flow 'volume_create_manager' (61bb8fba-fa25-49e7-a118-0dc85c9630e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb64cd7-e47a-4ccc-a16f-dbed30ed713a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb64cd7-e47a-4ccc-a16f-dbed30ed713a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-360726595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315a5233-20b4-4946-8826-4f1d2413c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f38eddf6b4967839283eb913ecba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:43Z,use_quota=True,user_id='f7ea262a97604d9ab9462d21ff136f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c96d2-56e2-4220-9ea7-caefbab69fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976c96d2-56e2-4220-9ea7-caefbab69fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d563b-8670-4993-a27d-a9b5fd32b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d563b-8670-4993-a27d-a9b5fd32b16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315a5233-20b4-4946-8826-4f1d2413c523', 'volume_name': 'volume-315a5233-20b4-4946-8826-4f1d2413c523', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890163a2-cb66-442d-aaea-59394fb0db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890163a2-cb66-442d-aaea-59394fb0db63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4529015-d321-4ebd-9dbd-7064e1d4842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:43 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Volume 315a5233-20b4-4946-8826-4f1d2413c523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315a5233-20b4-4946-8826-4f1d2413c523', 'volume_size': 1} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-360726595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315a5233-20b4-4946-8826-4f1d2413c523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f38eddf6b4967839283eb913ecba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:43Z,use_quota=True,user_id='f7ea262a97604d9ab9462d21ff136f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Creating volume 315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:39:43 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:43 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 1073741824 Jun 15 07:39:43 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:43 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 1073741824" returned: 0 in 0.738s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:43 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:39:43 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:44 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.563s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4529015-d321-4ebd-9dbd-7064e1d4842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315a5233-20b4-4946-8826-4f1d2413c523', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3110f4-5a24-4d74-9c1d-97b40dde86c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:44 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Volume volume-315a5233-20b4-4946-8826-4f1d2413c523 (315a5233-20b4-4946-8826-4f1d2413c523): created successfully Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3110f4-5a24-4d74-9c1d-97b40dde86c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:44 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Flow 'volume_create_manager' (61bb8fba-fa25-49e7-a118-0dc85c9630e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3d591402-c63b-4117-8b3d-2584db409bae tempest-VolumeDependencyTests-1210147478 None] Created volume successfully. Jun 15 07:39:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Creating offline snapshot b6a826ac-a0b2-47a6-9a25-881d9c5f6931 of volume 315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:39:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f019794-87c4-41db-9a13-89b904bb65ca]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:45 devstack sudo[110608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:39:45 devstack sudo[110608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:46 devstack sudo[110608]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.658s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:46 devstack sudo[110613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 1G Jun 15 07:39:46 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:46 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:39:46 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:46 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 1G" returned: 0 in 0.713s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a5233-20b4-4946-8826-4f1d2413c523 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:46 devstack sudo[110620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a5233-20b4-4946-8826-4f1d2413c523 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:39:46 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:47 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.577s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:39:47 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315a5233-20b4-4946-8826-4f1d2413c523 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.625s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:47 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 is being set with open permissions: ugo+rw Jun 15 07:39:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:47 devstack sudo[110626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:39:47 devstack sudo[110626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:48 devstack sudo[110626]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.602s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:48 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info Jun 15 07:39:48 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:48 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info" returned: 0 in 0.574s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:48 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info is being set with open permissions: ugo+rw Jun 15 07:39:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:48 devstack sudo[110632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info Jun 15 07:39:48 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:49 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.info" returned: 0 in 0.560s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.836s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e042ae8e-ac4b-4306-ba4e-85a88dd8ae03 tempest-VolumeDependencyTests-1210147478 None] Create snapshot completed successfully Jun 15 07:39:49 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:39:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Flow 'volume_create_manager' (7bee3e2c-81d9-4335-bcfa-b407819bcd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568e7688-afef-4a40-80e6-cf971a874181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568e7688-afef-4a40-80e6-cf971a874181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1910727240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f36d6d-4268-4547-a380-9b4f3a579736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f38eddf6b4967839283eb913ecba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6a826ac-a0b2-47a6-9a25-881d9c5f6931,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:39:50Z,use_quota=True,user_id='f7ea262a97604d9ab9462d21ff136f70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a4c7b-3744-4acc-8f75-7988bb1a7de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a4c7b-3744-4acc-8f75-7988bb1a7de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176152e-ebbc-44d4-b263-a335dd60c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176152e-ebbc-44d4-b263-a335dd60c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7f36d6d-4268-4547-a380-9b4f3a579736', 'volume_name': 'volume-b7f36d6d-4268-4547-a380-9b4f3a579736', 'volume_size': 1, 'snapshot_id': 'b6a826ac-a0b2-47a6-9a25-881d9c5f6931'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70093d47-7312-46d1-aead-eae9982ad4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70093d47-7312-46d1-aead-eae9982ad4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47610813-a5c4-4976-bec3-d8e0cec008a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:50 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Volume b7f36d6d-4268-4547-a380-9b4f3a579736: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7f36d6d-4268-4547-a380-9b4f3a579736', 'volume_size': 1, 'snapshot_id': 'b6a826ac-a0b2-47a6-9a25-881d9c5f6931'} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-b7f36d6d-4268-4547-a380-9b4f3a579736" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-b7f36d6d-4268-4547-a380-9b4f3a579736" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Creating volume b7f36d6d-4268-4547-a380-9b4f3a579736 from snapshot b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] snapshot: b6a826ac-a0b2-47a6-9a25-881d9c5f6931, volume: b7f36d6d-4268-4547-a380-9b4f3a579736, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c5152-3fa5-4bb6-b7e7-59966cd1fcd9]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:50 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:39:50 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:50 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.681s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315a5233-20b4-4946-8826-4f1d2413c523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[973e9034-aea2-4bcf-a389-693fe42d071e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:50 devstack sudo[110641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:39:50 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:51 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.676s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:51 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:39:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:51 devstack sudo[110646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 Jun 15 07:39:51 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:55 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736" returned: 0 in 4.417s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:55 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d3e220-b555-450e-91ae-eef7c813fd40]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:56 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:39:56 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:56 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.869s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:56 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523, size 1024.00 MB, duration 4.42 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:39:56 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Converted 1024.00 MB image at 231.77 MB/s Jun 15 07:39:56 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 is being set with open permissions: ugo+rw Jun 15 07:39:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:56 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 Jun 15 07:39:56 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:57 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736" returned: 0 in 0.572s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" released by "_copy_volume_from_snapshot" :: held 7.300s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-b7f36d6d-4268-4547-a380-9b4f3a579736" released by "_create_volume_from_snapshot" :: held 7.330s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.346s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47610813-a5c4-4976-bec3-d8e0cec008a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f36d6d-4268-4547-a380-9b4f3a579736', 'volume_size': 1, 'snapshot_id': 'b6a826ac-a0b2-47a6-9a25-881d9c5f6931'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb30c8-55a8-4b0b-83db-6075803ae7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:39:57 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Volume volume-b7f36d6d-4268-4547-a380-9b4f3a579736 (b7f36d6d-4268-4547-a380-9b4f3a579736): created successfully Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb30c8-55a8-4b0b-83db-6075803ae7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:39:57 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Flow 'volume_create_manager' (7bee3e2c-81d9-4335-bcfa-b407819bcd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:39:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-317a3077-f5a9-4e45-806a-8cfd6f7c13f3 tempest-VolumeDependencyTests-1210147478 None] Created volume successfully. Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Deleting offline snapshot b6a826ac-a0b2-47a6-9a25-881d9c5f6931 of volume 315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] snapshot_file for this snap is: volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3496d069-60b7-4ae1-a5af-22c1d28de72f]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:58 devstack sudo[110706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:39:58 devstack sudo[110706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:39:59 devstack sudo[110706]: pam_unix(sudo:session): session closed for user root Jun 15 07:39:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.668s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:39:59 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315a5233-20b4-4946-8826-4f1d2413c523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:39:59 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d6d42-160c-46e0-9b16-331042894230]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:39:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:39:59 devstack sudo[110711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:39:59 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:00 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.687s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:00 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:40:00 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:00 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.709s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:00 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931 Jun 15 07:40:00 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:01 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523.b6a826ac-a0b2-47a6-9a25-881d9c5f6931" returned: 0 in 0.633s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b6a826ac-a0b2-47a6-9a25-881d9c5f6931" released by "_delete_snapshot" :: held 2.791s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" released by "delete_snapshot" :: held 2.812s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Created reservations ['4dddddc7-088f-4b0f-a7f6-d69e0969a7d8', '981a829c-55d3-47fe-b52f-882810c7e1b2', 'b73c7a91-87ea-41e2-a349-6198b7eeb31e', '01470382-62e3-4867-9cf1-675c3bf8c5f0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Delete snapshot completed successfully. Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4902add1-ad81-4289-89d6-1c7414dab19f tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-b6a826ac-a0b2-47a6-9a25-881d9c5f6931-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-315a5233-20b4-4946-8826-4f1d2413c523-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-315a5233-20b4-4946-8826-4f1d2413c523-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c23d18-4cef-49a6-b8df-ec0895f3ffdf]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:01 devstack sudo[110724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:40:01 devstack sudo[110724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:02 devstack sudo[110724]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.672s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:02 devstack sudo[110729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523 Jun 15 07:40:02 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:03 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-315a5233-20b4-4946-8826-4f1d2413c523" returned: 0 in 0.632s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-315a5233-20b4-4946-8826-4f1d2413c523" released by "delete_volume" :: held 1.387s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Created reservations ['653def8c-7054-4b69-9170-913816b26823', '6888c75b-b068-428c-a556-7cfb6ead7a54', '96a6a994-35af-4714-bbae-6cca11d1d764', '377a3170-800d-4ef8-bf2a-5f1ee4b53d52'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:03 devstack sudo[110732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:40:03 devstack sudo[110732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:03 devstack sudo[110732]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.562s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:40:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Deleted volume successfully. Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0bff7d6c-65be-48cf-94a8-9937515956c2 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-315a5233-20b4-4946-8826-4f1d2413c523-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-b7f36d6d-4268-4547-a380-9b4f3a579736-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-b7f36d6d-4268-4547-a380-9b4f3a579736-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a7e15-165c-47dd-9327-4c35708a8e34]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:04 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 Jun 15 07:40:04 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:04 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736" returned: 0 in 0.738s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:04 devstack sudo[110741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736 Jun 15 07:40:04 devstack sudo[110741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:05 devstack sudo[110741]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b7f36d6d-4268-4547-a380-9b4f3a579736" returned: 0 in 0.612s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-quobyte-b7f36d6d-4268-4547-a380-9b4f3a579736" released by "delete_volume" :: held 1.395s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Created reservations ['4baffd3a-ac70-4959-9319-1a586a9ac1c2', '5068d82d-295e-44d9-a6c1-bf1a07151f28', 'cf70e749-2efb-408d-b8f0-36f4380c1e5a', '593a3ca8-c4b2-4520-9f02-b91ce648734d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:05 devstack sudo[110744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:40:05 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:06 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:06 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:40:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Deleted volume successfully. Jun 15 07:40:06 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2ddba9f8-cbef-4d94-b200-d372fe5b4643 tempest-VolumeDependencyTests-1210147478 None] Lock "cinder-b7f36d6d-4268-4547-a380-9b4f3a579736-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:15 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=47,cinder:UPDATE=62,cinder:INSERT=14,cinder:DELETE=4 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:40:16 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=56,cinder:DELETE=5,cinder:SELECT=46,cinder:INSERT=17 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Flow 'volume_create_manager' (cc37d131-07a7-44d6-99c7-d54c6ec0cbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6d391-b908-4801-aa07-b951b212cec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6d391-b908-4801-aa07-b951b212cec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-258087356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837b7186-659e-44e5-832b-1deabb0eb91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f15b8eb66324a048463b46a676da5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:40:24Z,use_quota=True,user_id='c4a8973766ac4721b74d773da3a5b25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5e245-4894-4e0a-a315-87acd80f0700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe5e245-4894-4e0a-a315-87acd80f0700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d9c5c5-9cee-4806-9875-bf1a5571019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d9c5c5-9cee-4806-9875-bf1a5571019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837b7186-659e-44e5-832b-1deabb0eb91e', 'volume_name': 'volume-837b7186-659e-44e5-832b-1deabb0eb91e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8a3b83-e696-444f-ad79-30ea2ac24822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8a3b83-e696-444f-ad79-30ea2ac24822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6826ef35-8626-4faf-badc-a597f8da28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:23 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Volume 837b7186-659e-44e5-832b-1deabb0eb91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837b7186-659e-44e5-832b-1deabb0eb91e', 'volume_size': 1} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-258087356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837b7186-659e-44e5-832b-1deabb0eb91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f15b8eb66324a048463b46a676da5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:40:24Z,use_quota=True,user_id='c4a8973766ac4721b74d773da3a5b25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Creating volume 837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:40:23 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:40:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:24 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e 1073741824 Jun 15 07:40:24 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:24 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e 1073741824" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:24 devstack sudo[110762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:24 devstack sudo[110762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:25 devstack sudo[110762]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.596s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6826ef35-8626-4faf-badc-a597f8da28c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837b7186-659e-44e5-832b-1deabb0eb91e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e78a87-7eba-49cf-ae2e-44209c4d7b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:25 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Volume volume-837b7186-659e-44e5-832b-1deabb0eb91e (837b7186-659e-44e5-832b-1deabb0eb91e): created successfully Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e78a87-7eba-49cf-ae2e-44209c4d7b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:25 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Flow 'volume_create_manager' (cc37d131-07a7-44d6-99c7-d54c6ec0cbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:40:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8e1572bb-18b8-4203-9e18-c5a34c1e3aff tempest-SnapshotDependencyTests-1435758710 None] Created volume successfully. Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Creating offline snapshot 46e3ce63-f9cc-4a26-a307-5455da6ed468 of volume 837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f03c20-a49c-4145-a0f3-7a1ea60e3820]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:26 devstack sudo[110765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:26 devstack sudo[110765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:26 devstack sudo[110765]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:26 devstack sudo[110770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 1G Jun 15 07:40:26 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:27 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 1G" returned: 0 in 0.713s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837b7186-659e-44e5-832b-1deabb0eb91e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:27 devstack sudo[110775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837b7186-659e-44e5-832b-1deabb0eb91e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:27 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:28 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837b7186-659e-44e5-832b-1deabb0eb91e -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.607s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:28 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 is being set with open permissions: ugo+rw Jun 15 07:40:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:28 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:28 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:28 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.639s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:28 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info Jun 15 07:40:28 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:29 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info" returned: 0 in 0.599s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:29 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info is being set with open permissions: ugo+rw Jun 15 07:40:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:29 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info Jun 15 07:40:29 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:30 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.info" returned: 0 in 0.567s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.885s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ffb53a58-758e-4c95-92fb-6c908750f848 tempest-SnapshotDependencyTests-1435758710 None] Create snapshot completed successfully Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Flow 'volume_create_manager' (9d856640-4273-43cc-848f-f60a2dadc6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10804690-c6a1-4a3e-93c4-5e47b3c8f4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10804690-c6a1-4a3e-93c4-5e47b3c8f4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302b7e23-e0ba-45b0-8372-b997eb7c1c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f15b8eb66324a048463b46a676da5e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46e3ce63-f9cc-4a26-a307-5455da6ed468,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:40:31Z,use_quota=True,user_id='c4a8973766ac4721b74d773da3a5b25e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91674191-62cb-4424-aadf-0a8ffde48405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91674191-62cb-4424-aadf-0a8ffde48405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65915fe0-414b-4297-8a05-bc5010544603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65915fe0-414b-4297-8a05-bc5010544603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '302b7e23-e0ba-45b0-8372-b997eb7c1c50', 'volume_name': 'volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50', 'volume_size': 1, 'snapshot_id': '46e3ce63-f9cc-4a26-a307-5455da6ed468'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ca267-2052-40a1-9354-127fb7aac479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ca267-2052-40a1-9354-127fb7aac479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ce6b7d-a62e-41d5-9dd5-6ee008b7a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Volume 302b7e23-e0ba-45b0-8372-b997eb7c1c50: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50', 'volume_size': 1, 'snapshot_id': '46e3ce63-f9cc-4a26-a307-5455da6ed468'} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468-302b7e23-e0ba-45b0-8372-b997eb7c1c50" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468-302b7e23-e0ba-45b0-8372-b997eb7c1c50" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Creating volume 302b7e23-e0ba-45b0-8372-b997eb7c1c50 from snapshot 46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] snapshot: 46e3ce63-f9cc-4a26-a307-5455da6ed468, volume: 302b7e23-e0ba-45b0-8372-b997eb7c1c50, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aabb1e9-2c5b-4551-b155-d59cfcc1b0d1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:31 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:31 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:31 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.719s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837b7186-659e-44e5-832b-1deabb0eb91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eccb532-d82b-47a9-aea5-f77648fa534c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:31 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:31 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:32 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.701s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:32 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:40:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:32 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 Jun 15 07:40:32 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:36 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50" returned: 0 in 4.321s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9298bdf5-076e-4d85-8528-ddea75102150]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:36 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:36 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:37 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.831s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:37 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:40:37 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Converted 1024.00 MB image at 236.86 MB/s Jun 15 07:40:37 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 is being set with open permissions: ugo+rw Jun 15 07:40:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:37 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 Jun 15 07:40:37 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:38 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50" returned: 0 in 0.588s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" released by "_copy_volume_from_snapshot" :: held 7.247s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468-302b7e23-e0ba-45b0-8372-b997eb7c1c50" released by "_create_volume_from_snapshot" :: held 7.273s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.287s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ce6b7d-a62e-41d5-9dd5-6ee008b7a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50', 'volume_size': 1, 'snapshot_id': '46e3ce63-f9cc-4a26-a307-5455da6ed468'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea2c9ac-d435-4e17-bf92-7b580e93b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:40:38 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Volume volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 (302b7e23-e0ba-45b0-8372-b997eb7c1c50): created successfully Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea2c9ac-d435-4e17-bf92-7b580e93b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Flow 'volume_create_manager' (9d856640-4273-43cc-848f-f60a2dadc6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:40:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-97d7edb1-96d2-45b3-826d-4ef66d857a1f tempest-SnapshotDependencyTests-1435758710 None] Created volume successfully. Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-46e3ce63-f9cc-4a26-a307-5455da6ed468-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-46e3ce63-f9cc-4a26-a307-5455da6ed468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Deleting offline snapshot 46e3ce63-f9cc-4a26-a307-5455da6ed468 of volume 837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] snapshot_file for this snap is: volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a91c1-7a69-407b-b2be-f004ac093868]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:38 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:38 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:39 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.702s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837b7186-659e-44e5-832b-1deabb0eb91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86a3f49-107c-4f19-8988-02f2942d2262]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:39 devstack sudo[110832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:39 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:39 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.671s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:39 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:39 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:40 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.644s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:40 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468 Jun 15 07:40:40 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:41 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e.46e3ce63-f9cc-4a26-a307-5455da6ed468" returned: 0 in 0.590s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-46e3ce63-f9cc-4a26-a307-5455da6ed468" released by "_delete_snapshot" :: held 2.710s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" released by "delete_snapshot" :: held 2.729s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Created reservations ['8e0dd6dc-c50f-4fe4-936c-138f35b134a1', '379feeb2-b5d7-413e-889f-73133ae76da9', '6f37a813-b942-4ec5-b226-80dcf145834b', '121d2ff7-642a-4468-8ddc-43dc0752eb6a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:41 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Delete snapshot completed successfully. Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc31c45d-44fc-426e-b0f0-a81fa0f7b48e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-46e3ce63-f9cc-4a26-a307-5455da6ed468-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-837b7186-659e-44e5-832b-1deabb0eb91e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-837b7186-659e-44e5-832b-1deabb0eb91e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" acquired by "delete_volume" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[15211432-ab10-4be5-b950-94d38f91848d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:41 devstack sudo[110845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:41 devstack sudo[110845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:42 devstack sudo[110845]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.671s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:42 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e Jun 15 07:40:42 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:43 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-837b7186-659e-44e5-832b-1deabb0eb91e" returned: 0 in 0.606s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-837b7186-659e-44e5-832b-1deabb0eb91e" released by "delete_volume" :: held 1.333s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Created reservations ['1243bd3d-56ac-490a-b213-e79e699c87cc', '809b1dee-8941-4b1f-bb4b-bba10e95a5c1', 'e9a2a07e-5b68-4dac-935c-312332ffa7ab', '335b5480-d651-4c3a-a607-f680e6247698'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:43 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:40:43 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:43 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.596s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:40:43 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Deleted volume successfully. Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-b651aa17-a1f9-46ad-960d-c65babf90f24 tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-837b7186-659e-44e5-832b-1deabb0eb91e-delete_volume" released by "delete_volume" :: held 2.106s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-302b7e23-e0ba-45b0-8372-b997eb7c1c50-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-302b7e23-e0ba-45b0-8372-b997eb7c1c50-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[413de1b4-2a57-4e61-8191-fa4c23e81fea]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:40:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:44 devstack sudo[110856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 Jun 15 07:40:44 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:44 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50" returned: 0 in 0.716s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:44 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50 Jun 15 07:40:44 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:45 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-302b7e23-e0ba-45b0-8372-b997eb7c1c50" returned: 0 in 0.584s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-quobyte-302b7e23-e0ba-45b0-8372-b997eb7c1c50" released by "delete_volume" :: held 1.340s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Created reservations ['f9709462-3f77-47e4-9ac7-b6fa46678bbe', 'c65137e0-5386-46ea-9948-e7ed12b584af', 'a0acdac5-502d-4dd6-9336-81ee31fa8b26', '30510647-f1d8-4fe8-99f0-0773327c1db0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:45 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:40:45 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:45 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.586s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:40:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Deleted volume successfully. Jun 15 07:40:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-51cff13a-a8d8-4878-9a1f-3fa75866df3e tempest-SnapshotDependencyTests-1435758710 None] Lock "cinder-302b7e23-e0ba-45b0-8372-b997eb7c1c50-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:40:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:40:46 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:40:46 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:40:47 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 15 07:40:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.608s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:40:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:40:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:40:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:40:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:40:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=30,cinder:INSERT=7,cinder:SELECT=22,cinder:DELETE=2 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:40:55 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=7 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (de937d6f-1469-4550-a23d-b0a2b1d68fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee58cfd7-220d-4ee3-b5e3-153ad575684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee58cfd7-220d-4ee3-b5e3-153ad575684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531310471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:04Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576bb654-d9a6-4d8b-8632-ce231a2a8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576bb654-d9a6-4d8b-8632-ce231a2a8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4033cf67-f935-47a5-aaee-ae3c15d9cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4033cf67-f935-47a5-aaee-ae3c15d9cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2', 'volume_name': 'volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be58fa71-05b9-4175-a6aa-f857844b969b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be58fa71-05b9-4175-a6aa-f857844b969b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a337f7b-8018-4347-8195-072211759614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume 6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2', 'volume_size': 1} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-531310471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:04Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume 6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:04 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:04 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 1073741824 Jun 15 07:41:04 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (4c521fd5-de1b-4fa6-906f-2f335e4c9503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3206ed80-f6ed-4467-8279-b57323aeae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3206ed80-f6ed-4467-8279-b57323aeae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15536565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98699cd-49cc-4d68-8301-7f416852e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:04Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950943f0-01a0-4cbf-ad08-6218d1cf561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950943f0-01a0-4cbf-ad08-6218d1cf561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ed9843-80a8-466d-8615-460a7739883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ed9843-80a8-466d-8615-460a7739883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98699cd-49cc-4d68-8301-7f416852e2cb', 'volume_name': 'volume-f98699cd-49cc-4d68-8301-7f416852e2cb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707713af-bf98-418f-b2ae-736018951ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707713af-bf98-418f-b2ae-736018951ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ff29f8-3c37-493b-9038-0716a24d95b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume f98699cd-49cc-4d68-8301-7f416852e2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98699cd-49cc-4d68-8301-7f416852e2cb', 'volume_size': 1} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (8b78897c-33d3-44b6-9b48-5b67a98eba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be00991-7e5e-49f6-96ff-518c107a82d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be00991-7e5e-49f6-96ff-518c107a82d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290444725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcee29c-29d2-4053-b3be-a4b572228d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:05Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d017c-a855-4e96-9b61-8c0417ba696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d017c-a855-4e96-9b61-8c0417ba696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a267ae6d-c7cc-416f-8cd0-267f436bb182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a267ae6d-c7cc-416f-8cd0-267f436bb182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcee29c-29d2-4053-b3be-a4b572228d47', 'volume_name': 'volume-3fcee29c-29d2-4053-b3be-a4b572228d47', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d53c4-d9d1-4d5f-b52c-463afa38559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d53c4-d9d1-4d5f-b52c-463afa38559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedc61a2-1e4e-48ad-a4c9-1b6b2e69b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Volume 3fcee29c-29d2-4053-b3be-a4b572228d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcee29c-29d2-4053-b3be-a4b572228d47', 'volume_size': 1} Jun 15 07:41:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (223a8e3d-636a-4f96-913a-7ec017c1fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb619c-299a-4d94-90ab-04e2ef81dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bb619c-299a-4d94-90ab-04e2ef81dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237985058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b21423-d12d-4810-9643-dce701458bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:05Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad9702b-b245-4a69-8f24-fae35af49dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad9702b-b245-4a69-8f24-fae35af49dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4423d269-925a-4b83-b973-3d3f268c9654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4423d269-925a-4b83-b973-3d3f268c9654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b21423-d12d-4810-9643-dce701458bea', 'volume_name': 'volume-d5b21423-d12d-4810-9643-dce701458bea', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86278c2b-65c8-448c-a4e3-012ac1432ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86278c2b-65c8-448c-a4e3-012ac1432ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b52fe-2cff-480e-9347-d6a1e5527bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Volume d5b21423-d12d-4810-9643-dce701458bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b21423-d12d-4810-9643-dce701458bea', 'volume_size': 1} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:05 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 1073741824" returned: 0 in 1.027s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:05 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 Jun 15 07:41:05 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (8059ad4c-9af8-45ff-a8b9-ab752f5cb59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c88529-5f6e-44c5-bbf1-fc31a4a1b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c88529-5f6e-44c5-bbf1-fc31a4a1b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320576763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955938c7-f090-4d16-9257-d076ebd540fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b25307-edef-4a38-a162-783cddf0ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b25307-edef-4a38-a162-783cddf0ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c514ac-904f-4dd4-a7c3-1425216c7821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c514ac-904f-4dd4-a7c3-1425216c7821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955938c7-f090-4d16-9257-d076ebd540fc', 'volume_name': 'volume-955938c7-f090-4d16-9257-d076ebd540fc', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2a1d9f-cacf-4378-86d7-d3a13ce45f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2a1d9f-cacf-4378-86d7-d3a13ce45f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb3296-b760-4b2b-93b0-71da8c3a7e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:05 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Volume 955938c7-f090-4d16-9257-d076ebd540fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955938c7-f090-4d16-9257-d076ebd540fc', 'volume_size': 1} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (7cbbc5ea-2963-45bf-a583-9170f5e15203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c789ebee-1058-46a5-b05e-0e509d10cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c789ebee-1058-46a5-b05e-0e509d10cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858171993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bebda5-268b-40b9-9941-2ed63052530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bebda5-268b-40b9-9941-2ed63052530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfb1d39-fab9-430e-be24-6262d4f3e1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfb1d39-fab9-430e-be24-6262d4f3e1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3', 'volume_name': 'volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8672df29-074c-4cf5-b822-a5c8feb93d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8672df29-074c-4cf5-b822-a5c8feb93d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81cb77f-45ed-4fa7-9fb3-3a60148651fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Volume f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3', 'volume_size': 1} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" returned: 0 in 0.750s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.474s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15536565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98699cd-49cc-4d68-8301-7f416852e2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:04Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:06 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a337f7b-8018-4347-8195-072211759614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1f4fa2-9012-41ea-b85e-ecdd59e1eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb 1073741824 Jun 15 07:41:06 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 (6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2): created successfully Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1f4fa2-9012-41ea-b85e-ecdd59e1eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (de937d6f-1469-4550-a23d-b0a2b1d68fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-9f0466d5-df88-49db-b4ca-f397e445a993 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (9add6072-7545-4912-a639-15c98b2f732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75657c87-b9f0-4fcd-b5ef-edaeeda2c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75657c87-b9f0-4fcd-b5ef-edaeeda2c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387149814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a6312d-a61d-43ce-be32-a968e42af243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f16073-5401-4065-8c9a-e1851d35fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f16073-5401-4065-8c9a-e1851d35fa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35edccc1-f75f-404e-9b40-62b989eebafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35edccc1-f75f-404e-9b40-62b989eebafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a6312d-a61d-43ce-be32-a968e42af243', 'volume_name': 'volume-32a6312d-a61d-43ce-be32-a968e42af243', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bdcc9c-4544-47f6-bffc-7dc8bbed7461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bdcc9c-4544-47f6-bffc-7dc8bbed7461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e64ad3b-bfb1-41f4-8c12-93409b9874b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Volume 32a6312d-a61d-43ce-be32-a968e42af243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a6312d-a61d-43ce-be32-a968e42af243', 'volume_size': 1} Jun 15 07:41:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:07 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb 1073741824" returned: 0 in 0.947s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (d60015b1-4e2b-4d0b-b500-1c448e783262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202105f-d910-4338-9958-d4f7bcbce6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6202105f-d910-4338-9958-d4f7bcbce6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677320317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb51b4-4847-43ee-8449-3dd0fe347acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:07Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb Jun 15 07:41:07 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1b732-1e76-42ba-8748-c93349e3ee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c1b732-1e76-42ba-8748-c93349e3ee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3b43b9-6128-4604-a4c5-5d662f920c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3b43b9-6128-4604-a4c5-5d662f920c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdb51b4-4847-43ee-8449-3dd0fe347acb', 'volume_name': 'volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e6c72a-0223-435e-b0e8-8a346dca2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e6c72a-0223-435e-b0e8-8a346dca2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c751703-1319-421f-8b6d-7492d0b577cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume 8bdb51b4-4847-43ee-8449-3dd0fe347acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb', 'volume_size': 1} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (4685b273-bad8-48c3-a26b-f83be80d5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0d6081-0fa7-4436-afe1-7268d74662a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0d6081-0fa7-4436-afe1-7268d74662a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261459019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2676b429-994d-49be-a2f7-3ea9b755f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:07Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069a7f31-f8a1-4efd-a610-cc27eefe4286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (069a7f31-f8a1-4efd-a610-cc27eefe4286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb341330-db95-44cd-b29c-7a85985fe66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb341330-db95-44cd-b29c-7a85985fe66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2676b429-994d-49be-a2f7-3ea9b755f932', 'volume_name': 'volume-2676b429-994d-49be-a2f7-3ea9b755f932', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b587e968-596a-41df-a979-75378671d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b587e968-596a-41df-a979-75378671d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab0a4e-3390-4306-b9f7-17ca50567f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume 2676b429-994d-49be-a2f7-3ea9b755f932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2676b429-994d-49be-a2f7-3ea9b755f932', 'volume_size': 1} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:07 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-290444725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcee29c-29d2-4053-b3be-a4b572228d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:05Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Creating volume 3fcee29c-29d2-4053-b3be-a4b572228d47 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ff29f8-3c37-493b-9038-0716a24d95b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98699cd-49cc-4d68-8301-7f416852e2cb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d852906-a982-47b2-9822-63b294127871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 1073741824 Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:07 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (428a5cb2-25d7-4b25-9a59-83bba9b3fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0ef7d2-3fef-481f-ab2e-37fbf2ff52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-f98699cd-49cc-4d68-8301-7f416852e2cb (f98699cd-49cc-4d68-8301-7f416852e2cb): created successfully Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d852906-a982-47b2-9822-63b294127871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (4c521fd5-de1b-4fa6-906f-2f335e4c9503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0ef7d2-3fef-481f-ab2e-37fbf2ff52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400858285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7199b11a-582d-43d9-a55d-555d197c5da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:08Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfb1fa-8df4-4f8f-bd54-23ba16e77046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54cfb1fa-8df4-4f8f-bd54-23ba16e77046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe415a9-b9cc-4798-a4c8-4d763690250f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe415a9-b9cc-4798-a4c8-4d763690250f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7199b11a-582d-43d9-a55d-555d197c5da8', 'volume_name': 'volume-7199b11a-582d-43d9-a55d-555d197c5da8', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89068d01-f37c-4ded-9d6d-c55465ed69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89068d01-f37c-4ded-9d6d-c55465ed69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fbf3e-bb06-4269-95a7-efdce90d23bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume 7199b11a-582d-43d9-a55d-555d197c5da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7199b11a-582d-43d9-a55d-555d197c5da8', 'volume_size': 1} Jun 15 07:41:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-53d7577b-3a05-46f1-b03a-a174a0b53ac2 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (69621b46-26ac-450d-a942-24424c97bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0f0a2a-4989-42a8-bf05-e45036b1316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0f0a2a-4989-42a8-bf05-e45036b1316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141389081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0274d19-72fd-421c-9230-c0c2680c4857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:08Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6780cf24-cd68-4361-9bbc-8e01d31b8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6780cf24-cd68-4361-9bbc-8e01d31b8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd4a2a3-8656-4868-ba7b-205e2f9280a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd4a2a3-8656-4868-ba7b-205e2f9280a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0274d19-72fd-421c-9230-c0c2680c4857', 'volume_name': 'volume-d0274d19-72fd-421c-9230-c0c2680c4857', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2b8c16-1792-411a-85cd-b796ae767f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2b8c16-1792-411a-85cd-b796ae767f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd20bae-b40e-43df-af38-35939404ff02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume d0274d19-72fd-421c-9230-c0c2680c4857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0274d19-72fd-421c-9230-c0c2680c4857', 'volume_size': 1} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (90ec2e29-cd8e-4f89-9731-e5197f84e03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68aa47d1-77ea-47c7-94e0-da8262c9e29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68aa47d1-77ea-47c7-94e0-da8262c9e29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1571628024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65842fd1-c4c4-4118-9171-fc21e569eea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:09Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c13c39-f5c4-499e-a300-5ed433b092c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c13c39-f5c4-499e-a300-5ed433b092c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0521e0d2-1a36-4610-903f-543a5a243e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0521e0d2-1a36-4610-903f-543a5a243e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65842fd1-c4c4-4118-9171-fc21e569eea1', 'volume_name': 'volume-65842fd1-c4c4-4118-9171-fc21e569eea1', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53000593-a308-4acf-b7ad-d169d603d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53000593-a308-4acf-b7ad-d169d603d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fc5e1c-5240-4847-896a-a42e87950694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume 65842fd1-c4c4-4118-9171-fc21e569eea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65842fd1-c4c4-4118-9171-fc21e569eea1', 'volume_size': 1} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:08 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 1073741824" returned: 0 in 0.979s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:08 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 Jun 15 07:41:08 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Flow 'volume_create_manager' (e374d424-0653-4b74-a5d1-431243f34cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f39d8f5-0c13-4717-bd1d-4364b6e5f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f39d8f5-0c13-4717-bd1d-4364b6e5f84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3992aae-4976-4772-945c-215a0c18b624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4043e630384c0790df9d7bd2eabced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:09Z,use_quota=True,user_id='ce85259cfd5c4792bd400ed624b80b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc04bc49-4527-4ecf-8a3b-cbfe7a01fe88),volume_type_id=cc04bc49-4527-4ecf-8a3b-cbfe7a01fe88)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c965a6e5-c6f2-41ae-a816-ec2cafb07044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c965a6e5-c6f2-41ae-a816-ec2cafb07044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82737e9-b10e-4647-bc1b-3ceac2c11dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:08 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82737e9-b10e-4647-bc1b-3ceac2c11dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f3992aae-4976-4772-945c-215a0c18b624', 'volume_name': 'volume-f3992aae-4976-4772-945c-215a0c18b624', 'volume_size': 1, 'image_id': '5938f602-cf9a-455a-bb60-f45b983da940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8ae8d678f3040885f9a96a6aa9cbf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b4043e630384c0790df9d7bd2eabced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfa42b51d317e818825db86534b26524ffa4176e3f29bc9dc5ccaeb7b825d934d9c142d1abc3bc479a388e137a917ecdbcea56bb063e4071c70f443e05029a78', 'id': '5938f602-cf9a-455a-bb60-f45b983da940', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5938f602-cf9a-455a-bb60-f45b983da940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841190b-b40a-45a2-8588-e58e2422400c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841190b-b40a-45a2-8588-e58e2422400c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebb23d0-224c-4992-a2b7-e050c1422826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:09 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Volume f3992aae-4976-4772-945c-215a0c18b624: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f3992aae-4976-4772-945c-215a0c18b624', 'volume_size': 1, 'image_id': '5938f602-cf9a-455a-bb60-f45b983da940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8ae8d678f3040885f9a96a6aa9cbf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b4043e630384c0790df9d7bd2eabced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfa42b51d317e818825db86534b26524ffa4176e3f29bc9dc5ccaeb7b825d934d9c142d1abc3bc479a388e137a917ecdbcea56bb063e4071c70f443e05029a78', 'id': '5938f602-cf9a-455a-bb60-f45b983da940', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5938f602-cf9a-455a-bb60-f45b983da940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Trying to clone f3992aae-4976-4772-945c-215a0c18b624 from image 5938f602-cf9a-455a-bb60-f45b983da940 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:41:09 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0514e2-e8ce-4311-a771-7ca31b4a5141]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:09 devstack sudo[110980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:09 devstack sudo[110980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:09 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47" returned: 0 in 0.651s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.331s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1237985058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b21423-d12d-4810-9643-dce701458bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:05Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Creating volume d5b21423-d12d-4810-9643-dce701458bea {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:09 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eedc61a2-1e4e-48ad-a4c9-1b6b2e69b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcee29c-29d2-4053-b3be-a4b572228d47', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d329e9d-1fbd-4576-8ceb-83921db8eda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:09 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea 1073741824 Jun 15 07:41:09 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:09 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Volume volume-3fcee29c-29d2-4053-b3be-a4b572228d47 (3fcee29c-29d2-4053-b3be-a4b572228d47): created successfully Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d329e9d-1fbd-4576-8ceb-83921db8eda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:09 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (8b78897c-33d3-44b6-9b48-5b67a98eba49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-53a31502-641a-4b1e-91ba-cddc4cd4956d tempest-CreateVolumesFromImageTest-801706928 None] Created volume successfully. Jun 15 07:41:10 devstack sudo[110980]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:10 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:10 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:10 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea 1073741824" returned: 0 in 0.808s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:10 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea Jun 15 07:41:10 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:10 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 1 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Temporary image 5938f602-cf9a-455a-bb60-f45b983da940 is fetched for user ce85259cfd5c4792bd400ed624b80b6e. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[79078bdb-b14b-4ec5-8e76-e56b779483e2]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:10 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:10 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:10 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea" returned: 0 in 0.590s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1320576763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955938c7-f090-4d16-9257-d076ebd540fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Creating volume 955938c7-f090-4d16-9257-d076ebd540fc {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:10 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:11 devstack sudo[111000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc 1073741824 Jun 15 07:41:11 devstack sudo[111000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b52fe-2cff-480e-9347-d6a1e5527bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b21423-d12d-4810-9643-dce701458bea', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b50fe0-40b6-4ed8-adcd-7a003449cfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:11 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Volume volume-d5b21423-d12d-4810-9643-dce701458bea (d5b21423-d12d-4810-9643-dce701458bea): created successfully Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b50fe0-40b6-4ed8-adcd-7a003449cfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (223a8e3d-636a-4f96-913a-7ec017c1fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:11 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4086fd41-17f0-4600-a01c-c659df4bf2db tempest-CreateVolumesFromImageTest-801706928 None] Created volume successfully. Jun 15 07:41:11 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:11 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:11 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:11 devstack sudo[111000]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc 1073741824" returned: 0 in 0.741s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:11 devstack sudo[111010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc Jun 15 07:41:11 devstack sudo[111010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:12 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:12 devstack sudo[111010]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc" returned: 0 in 0.600s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.299s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-858171993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Creating volume f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:12 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb3296-b760-4b2b-93b0-71da8c3a7e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955938c7-f090-4d16-9257-d076ebd540fc', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:12 devstack sudo[111016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 1073741824 Jun 15 07:41:12 devstack sudo[111016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17046e03-9572-46a9-818b-b40a499d3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:12 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Volume volume-955938c7-f090-4d16-9257-d076ebd540fc (955938c7-f090-4d16-9257-d076ebd540fc): created successfully Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17046e03-9572-46a9-818b-b40a499d3ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:12 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (8059ad4c-9af8-45ff-a8b9-ab752f5cb59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:12 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4e1c9762-5f34-4eec-ae9e-19efc834bc5a tempest-CreateVolumesFromImageTest-801706928 None] Created volume successfully. Jun 15 07:41:13 devstack sudo[111016]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 1073741824" returned: 0 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:13 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 Jun 15 07:41:13 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:13 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" returned: 0 in 0.586s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.413s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387149814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a6312d-a61d-43ce-be32-a968e42af243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0d6cdf03fe47dcb8e95f3f168f82de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:06Z,use_quota=True,user_id='bb72917b22be4f2f8f5eae1fece5bea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Creating volume 32a6312d-a61d-43ce-be32-a968e42af243 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:13 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:13 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 1073741824 Jun 15 07:41:13 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81cb77f-45ed-4fa7-9fb3-3a60148651fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f531986-dd32-4b1b-bdc5-82550aa43ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:13 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Volume volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 (f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3): created successfully Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f531986-dd32-4b1b-bdc5-82550aa43ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:13 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (7cbbc5ea-2963-45bf-a583-9170f5e15203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:13 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-1bbcc9a8-13f6-4d5d-9900-d6a65e5e9af7 tempest-CreateVolumesFromImageTest-801706928 None] Created volume successfully. Jun 15 07:41:14 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 1073741824" returned: 0 in 0.790s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:14 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 Jun 15 07:41:14 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:15 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243" returned: 0 in 0.585s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.051s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1677320317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdb51b4-4847-43ee-8449-3dd0fe347acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:07Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume 8bdb51b4-4847-43ee-8449-3dd0fe347acb {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:15 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e64ad3b-bfb1-41f4-8c12-93409b9874b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a6312d-a61d-43ce-be32-a968e42af243', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:15 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb 1073741824 Jun 15 07:41:15 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1610ef73-961b-4722-8552-fdfd94666b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Volume volume-32a6312d-a61d-43ce-be32-a968e42af243 (32a6312d-a61d-43ce-be32-a968e42af243): created successfully Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1610ef73-961b-4722-8552-fdfd94666b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Flow 'volume_create_manager' (9add6072-7545-4912-a639-15c98b2f732b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:15 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b6ae6ba2-7e8b-4db4-8c5e-9317e425983b tempest-CreateVolumesFromImageTest-801706928 None] Created volume successfully. Jun 15 07:41:16 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb 1073741824" returned: 0 in 0.758s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:16 devstack sudo[111040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb Jun 15 07:41:16 devstack sudo[111040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-32a6312d-a61d-43ce-be32-a968e42af243-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-32a6312d-a61d-43ce-be32-a968e42af243-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-quobyte-32a6312d-a61d-43ce-be32-a968e42af243" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-32a6312d-a61d-43ce-be32-a968e42af243" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424f482-1a7d-47c3-90c5-2041e631c6a1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:16 devstack sudo[111042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 Jun 15 07:41:16 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:16 devstack sudo[111040]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb" returned: 0 in 0.610s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.170s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1261459019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2676b429-994d-49be-a2f7-3ea9b755f932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:07Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume 2676b429-994d-49be-a2f7-3ea9b755f932 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:16 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:16 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 1073741824 Jun 15 07:41:16 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c751703-1319-421f-8b6d-7492d0b577cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b61c77-279a-4857-a503-3a41c9925641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:16 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb (8bdb51b4-4847-43ee-8449-3dd0fe347acb): created successfully Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b61c77-279a-4857-a503-3a41c9925641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:16 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (d60015b1-4e2b-4d0b-b500-1c448e783262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:16 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-15716619-bfda-44ce-ad17-dc72046c08db tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:17 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:17 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243 Jun 15 07:41:17 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:17 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 1073741824" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:17 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 Jun 15 07:41:17 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:17 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-32a6312d-a61d-43ce-be32-a968e42af243" returned: 0 in 0.670s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-32a6312d-a61d-43ce-be32-a968e42af243" released by "delete_volume" :: held 1.450s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:17 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Created reservations ['aad06e6f-d2f1-47ee-910a-2d7ec9f783f1', '7985fb19-d6cb-4eaf-b070-df665ce0f070', '0efa2287-77a2-4108-ab21-6450d41b44d7', '0f185fe5-38bc-408d-8ddb-50d10a7d44c6'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:18 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:18 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:18 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.159s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400858285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7199b11a-582d-43d9-a55d-555d197c5da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:08Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume 7199b11a-582d-43d9-a55d-555d197c5da8 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:18 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab0a4e-3390-4306-b9f7-17ca50567f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2676b429-994d-49be-a2f7-3ea9b755f932', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:18 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 1073741824 Jun 15 07:41:18 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850fccea-1b62-4baa-93b7-5d4f4d3d1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:18 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-2676b429-994d-49be-a2f7-3ea9b755f932 (2676b429-994d-49be-a2f7-3ea9b755f932): created successfully Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850fccea-1b62-4baa-93b7-5d4f4d3d1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (4685b273-bad8-48c3-a26b-f83be80d5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:18 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-77819491-ef30-41fe-8b16-9ead1a2fca09 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-quobyte-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:18 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.639s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:18 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Deleted volume successfully. Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4daa26f5-c3f8-41be-b8a5-a788efe1205a tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-32a6312d-a61d-43ce-be32-a968e42af243-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8abc004-33fe-48af-8999-75d83d7594a0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:18 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:18 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 Jun 15 07:41:18 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:19 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 1073741824" returned: 0 in 0.868s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:19 devstack sudo[111070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 Jun 15 07:41:19 devstack sudo[111070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:19 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" returned: 0 in 0.775s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:19 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3 Jun 15 07:41:19 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:19 devstack sudo[111070]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8" returned: 0 in 0.637s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.386s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141389081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0274d19-72fd-421c-9230-c0c2680c4857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:08Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume d0274d19-72fd-421c-9230-c0c2680c4857 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:19 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c58fbf3e-bb06-4269-95a7-efdce90d23bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7199b11a-582d-43d9-a55d-555d197c5da8', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:19 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 1073741824 Jun 15 07:41:19 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0ca783-3886-497a-87eb-ce30b064a053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:19 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-7199b11a-582d-43d9-a55d-555d197c5da8 (7199b11a-582d-43d9-a55d-555d197c5da8): created successfully Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0ca783-3886-497a-87eb-ce30b064a053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:19 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (428a5cb2-25d7-4b25-9a59-83bba9b3fd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:19 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2d8659da-b992-4dbf-b13a-62aef0f07ba2 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:20 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3" released by "delete_volume" :: held 1.419s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Created reservations ['0ad63573-c12e-4473-ad7b-3709a9825874', 'af066a6c-903e-474c-a6ae-b11d516503ed', 'a1d4e880-f171-45be-9c3f-de330d8e8b0f', 'c8de1e70-6208-48d8-a26e-d32df2ec9d6d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:20 devstack sudo[111082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:20 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:20 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 1073741824" returned: 0 in 0.828s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:20 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 Jun 15 07:41:20 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-955938c7-f090-4d16-9257-d076ebd540fc-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-955938c7-f090-4d16-9257-d076ebd540fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:20 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.677s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:20 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Deleted volume successfully. Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-quobyte-955938c7-f090-4d16-9257-d076ebd540fc" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-5b607c0c-fafe-4cfa-8bf1-ae0d7df14c14 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-f1fbd3ef-73dc-4fb3-854a-8ddda9a7f9a3-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-955938c7-f090-4d16-9257-d076ebd540fc" acquired by "delete_volume" :: waited 0.014s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb7dee9-8b23-4e5d-8fd9-18ef2557c37d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:21 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc Jun 15 07:41:21 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:21 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857" returned: 0 in 0.627s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.543s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1571628024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65842fd1-c4c4-4118-9171-fc21e569eea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29787d902ca344dfb15812a3fc29c9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:09Z,use_quota=True,user_id='fffb87fdae73441495935cd633e4f4a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Creating volume 65842fd1-c4c4-4118-9171-fc21e569eea1 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:21 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd20bae-b40e-43df-af38-35939404ff02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0274d19-72fd-421c-9230-c0c2680c4857', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:21 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 1073741824 Jun 15 07:41:21 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d12257-285d-4434-9379-9191c31bb21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:21 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-d0274d19-72fd-421c-9230-c0c2680c4857 (d0274d19-72fd-421c-9230-c0c2680c4857): created successfully Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d12257-285d-4434-9379-9191c31bb21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (69621b46-26ac-450d-a942-24424c97bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:21 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ba783ea8-4e3f-4b02-adbd-b6c5aa11da4c tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:21 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc" returned: 0 in 0.753s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:21 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc Jun 15 07:41:21 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:22 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 1073741824" returned: 0 in 0.813s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:22 devstack sudo[111105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 Jun 15 07:41:22 devstack sudo[111105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:22 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-955938c7-f090-4d16-9257-d076ebd540fc" returned: 0 in 0.619s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-955938c7-f090-4d16-9257-d076ebd540fc" released by "delete_volume" :: held 1.420s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Created reservations ['c05e15ff-3eba-4020-8fa4-fa58a44a0419', '424e1a21-9d52-4ec8-b543-6cb6631a0476', '03483b17-8227-4c95-a3d3-05ed79f8ff77', 'd781de05-9c92-43ed-be69-163d78641e33'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:22 devstack sudo[111108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:22 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:22 devstack sudo[111105]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1" returned: 0 in 0.602s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.722s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating offline snapshot b22c32b7-5663-4fc2-b760-3c918a3ab820 of volume f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fc5e1c-5240-4847-896a-a42e87950694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65842fd1-c4c4-4118-9171-fc21e569eea1', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf79a7-aaeb-4917-8d7f-44c71eb592ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa576dc6-61af-4c06-a1c1-66abb71e7236]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:22 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Volume volume-65842fd1-c4c4-4118-9171-fc21e569eea1 (65842fd1-c4c4-4118-9171-fc21e569eea1): created successfully Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cf79a7-aaeb-4917-8d7f-44c71eb592ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Flow 'volume_create_manager' (90ec2e29-cd8e-4f89-9731-e5197f84e03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-453ed8af-5164-4fec-950a-e24a23fe5d02 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created volume successfully. Jun 15 07:41:22 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb Jun 15 07:41:22 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-d5b21423-d12d-4810-9643-dce701458bea-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-d5b21423-d12d-4810-9643-dce701458bea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-quobyte-d5b21423-d12d-4810-9643-dce701458bea" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:23 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.650s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:23 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Deleted volume successfully. Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-d5b21423-d12d-4810-9643-dce701458bea" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b9b6fb-8a5c-48dc-978d-4254d84eeaed]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-ec357f8e-6dc9-4840-94a9-bf925599486b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-955938c7-f090-4d16-9257-d076ebd540fc-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:23 devstack sudo[111114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea Jun 15 07:41:23 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:23 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb" returned: 0 in 0.760s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:23 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 1G Jun 15 07:41:23 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-65842fd1-c4c4-4118-9171-fc21e569eea1-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-65842fd1-c4c4-4118-9171-fc21e569eea1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:23 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-65842fd1-c4c4-4118-9171-fc21e569eea1" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:23 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea" returned: 0 in 0.778s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-65842fd1-c4c4-4118-9171-fc21e569eea1" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:24 devstack sudo[111124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea Jun 15 07:41:24 devstack sudo[111124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1562d38-7cca-4a34-a997-4d7ced4f64c2]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:24 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 Jun 15 07:41:24 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:24 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 1G" returned: 0 in 0.769s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98699cd-49cc-4d68-8301-7f416852e2cb -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:24 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98699cd-49cc-4d68-8301-7f416852e2cb -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 Jun 15 07:41:24 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:24 devstack sudo[111124]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d5b21423-d12d-4810-9643-dce701458bea" returned: 0 in 0.647s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-d5b21423-d12d-4810-9643-dce701458bea" released by "delete_volume" :: held 1.474s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Created reservations ['11cfa109-7e81-4c20-ae24-2f393d404d22', '5fa3868a-2f2d-41aa-8ab3-0a5c586c49d9', '4a3169fe-7724-4460-9a76-4d96503ebf11', 'fd3bb306-b47a-4fc3-b282-8f2df07ee8e1'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:24 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:24 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1" returned: 0 in 0.792s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:24 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:24 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1 Jun 15 07:41:24 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:24 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98699cd-49cc-4d68-8301-7f416852e2cb -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820" returned: 0 in 0.671s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:24 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 is being set with open permissions: ugo+rw Jun 15 07:41:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:25 devstack sudo[111145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 Jun 15 07:41:25 devstack sudo[111145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:25 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:25 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Deleted volume successfully. Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-fc1e2c6d-96c0-43ed-b2d7-94b0f829b137 tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-d5b21423-d12d-4810-9643-dce701458bea-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:25 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-65842fd1-c4c4-4118-9171-fc21e569eea1" returned: 0 in 0.651s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-65842fd1-c4c4-4118-9171-fc21e569eea1" released by "delete_volume" :: held 1.495s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['ef54c0ab-5f0b-433f-9ab2-890526805f80', 'f624efd7-9cb0-455a-bb9e-09772292ec39', 'e9f8346d-2e55-49f4-9193-fa4585854b9a', 'd1730e40-ca17-4507-9fe9-b20921fea69b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:25 devstack sudo[111145]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-3fcee29c-29d2-4053-b3be-a4b572228d47-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820" returned: 0 in 0.683s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:25 devstack sudo[111150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:25 devstack sudo[111150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-3fcee29c-29d2-4053-b3be-a4b572228d47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:25 devstack sudo[111152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info Jun 15 07:41:25 devstack sudo[111152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "cinder-quobyte-3fcee29c-29d2-4053-b3be-a4b572228d47" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-3fcee29c-29d2-4053-b3be-a4b572228d47" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67eac6f-bbf3-44c0-aaf1-ffbefa1606bd]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:25 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 Jun 15 07:41:25 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-d0274d19-72fd-421c-9230-c0c2680c4857-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-d0274d19-72fd-421c-9230-c0c2680c4857-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-d0274d19-72fd-421c-9230-c0c2680c4857" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-d0274d19-72fd-421c-9230-c0c2680c4857" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7000bca-b70b-4cae-bbfa-2158c9819cf1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:26 devstack sudo[111150]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.682s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e9d4c968-0e3f-4c09-b184-d2863d3a87e5 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-65842fd1-c4c4-4118-9171-fc21e569eea1-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:26 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 Jun 15 07:41:26 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:26 devstack sudo[111152]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info" returned: 0 in 0.727s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:26 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info is being set with open permissions: ugo+rw Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:26 devstack sudo[111163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info Jun 15 07:41:26 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:26 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47" returned: 0 in 0.749s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:26 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47 Jun 15 07:41:26 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:27 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857" returned: 0 in 0.792s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:27 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.info" returned: 0 in 0.647s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:27 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857 Jun 15 07:41:27 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.376s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.850s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3992aae-4976-4772-945c-215a0c18b624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4043e630384c0790df9d7bd2eabced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:09Z,use_quota=True,user_id='ce85259cfd5c4792bd400ed624b80b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc04bc49-4527-4ecf-8a3b-cbfe7a01fe88),volume_type_id=cc04bc49-4527-4ecf-8a3b-cbfe7a01fe88)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Creating volume f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:27 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:27 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:27 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1073741824 Jun 15 07:41:27 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-3fcee29c-29d2-4053-b3be-a4b572228d47" returned: 0 in 0.622s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:27 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c4271a9f-f1f5-4eb5-a0ab-62180e93510e tempest-CreateVolumesFromSnapshotTest-219778853 None] Create snapshot completed successfully Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-quobyte-3fcee29c-29d2-4053-b3be-a4b572228d47" released by "delete_volume" :: held 1.424s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Created reservations ['4f07ce50-e6c8-4a4b-aef8-2b53ff0b7042', '0b785514-6c52-4c9c-bfa1-9a0efeb02843', 'a473ae8c-987a-4da5-a667-f0e2140e9c2f', 'b79dd9d3-1815-41bd-8f5e-5cd6d323552b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:27 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:27 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:27 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-d0274d19-72fd-421c-9230-c0c2680c4857" returned: 0 in 0.665s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-d0274d19-72fd-421c-9230-c0c2680c4857" released by "delete_volume" :: held 1.511s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['84398837-0403-44f9-beed-9aa14d974d93', '5910cb9d-6739-427b-9c2e-4e1e4a8f9a5c', '06c9e352-f0cb-4e75-be9b-d74241f2f9fe', '19852ac7-6d6e-44a9-8916-c949b0e43728'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:27 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:28 devstack sudo[111183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:28 devstack sudo[111183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:28 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.837s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:28 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:28 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Deleted volume successfully. Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1073741824" returned: 0 in 1.050s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-e8364192-aae0-41f4-b5e4-6664a753d33b tempest-CreateVolumesFromImageTest-801706928 None] Lock "cinder-3fcee29c-29d2-4053-b3be-a4b572228d47-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:28 devstack sudo[111185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:28 devstack sudo[111185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (587b69b2-7dc7-4446-96e0-015371569dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f5466-ccba-4270-92eb-0910e5cb9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f5466-ccba-4270-92eb-0910e5cb9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644843152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b16db06-3b62-4b8a-abb4-28deed3f981e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:28Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596916e-7f2d-4ec1-acad-9a2bd848342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4596916e-7f2d-4ec1-acad-9a2bd848342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b5ef32-69a0-4898-8e39-8b044671e77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b5ef32-69a0-4898-8e39-8b044671e77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b16db06-3b62-4b8a-abb4-28deed3f981e', 'volume_name': 'volume-2b16db06-3b62-4b8a-abb4-28deed3f981e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a9894-76fa-4c42-85e0-470e98b4ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18a9894-76fa-4c42-85e0-470e98b4ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2094a2-6645-44b3-8433-fec08a52d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:28 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume 2b16db06-3b62-4b8a-abb4-28deed3f981e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b16db06-3b62-4b8a-abb4-28deed3f981e', 'volume_size': 1} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-7199b11a-582d-43d9-a55d-555d197c5da8-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-7199b11a-582d-43d9-a55d-555d197c5da8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-7199b11a-582d-43d9-a55d-555d197c5da8" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-7199b11a-582d-43d9-a55d-555d197c5da8" acquired by "delete_volume" :: waited 0.030s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[577d486e-fee6-410c-9430-0308f720f2c1]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:28 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (ea8c00bf-bba8-4a42-90bc-b0c76d2e9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039109b7-a61a-46a0-a86d-97351246ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (039109b7-a61a-46a0-a86d-97351246ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330060274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0525f7-30ad-4534-a08d-575b18a4a42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:29Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cea5bb5-3197-427f-b6c2-6f0d0f7e1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cea5bb5-3197-427f-b6c2-6f0d0f7e1acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d12bff4-7084-4be7-a461-51203ad5ff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d12bff4-7084-4be7-a461-51203ad5ff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0525f7-30ad-4534-a08d-575b18a4a42c', 'volume_name': 'volume-6f0525f7-30ad-4534-a08d-575b18a4a42c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1bc5bd-fcd8-4b7f-85e5-b3f33bc488c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a1bc5bd-fcd8-4b7f-85e5-b3f33bc488c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396fe6d5-0072-452b-a7b0-c0a306a300c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume 6f0525f7-30ad-4534-a08d-575b18a4a42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0525f7-30ad-4534-a08d-575b18a4a42c', 'volume_size': 1} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:29 devstack sudo[111185]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 0 in 0.935s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644843152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b16db06-3b62-4b8a-abb4-28deed3f981e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:28Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume 2b16db06-3b62-4b8a-abb4-28deed3f981e {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:29 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:29 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e 1073741824 Jun 15 07:41:29 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Attempting download of 5938f602-cf9a-455a-bb60-f45b983da940 ((None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}])) to volume f3992aae-4976-4772-945c-215a0c18b624. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:41:29 devstack sudo[111183]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.273s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:29 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f0f8a6fc-e7e2-4f4b-8304-b29bc300e869 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-d0274d19-72fd-421c-9230-c0c2680c4857-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7ae74d-0d20-41ed-bc90-1695adfcb18e]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:29 devstack sudo[111193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c Jun 15 07:41:29 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (0dd275ff-7a82-44b5-a726-ca361bcc3bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdf05b9-412f-4a2a-8628-3ea0b450a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cdf05b9-412f-4a2a-8628-3ea0b450a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114358680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c9d43f-c1c1-4806-87d8-f22fe0897b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:30Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05c115-92fd-450d-8786-fcef6dcf13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f05c115-92fd-450d-8786-fcef6dcf13f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96665428-c715-44e1-bca6-1811c471d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96665428-c715-44e1-bca6-1811c471d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c9d43f-c1c1-4806-87d8-f22fe0897b90', 'volume_name': 'volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d840318-39e5-47b7-9a78-6ae48ad434df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d840318-39e5-47b7-9a78-6ae48ad434df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6a9f5c-19df-489a-b27b-b5dd66710585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:29 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume b4c9d43f-c1c1-4806-87d8-f22fe0897b90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90', 'volume_size': 1} Jun 15 07:41:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (e089a1fb-39a1-48ee-b2a6-2fb69e20c79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d24014-337a-4204-8efe-4a2c46ae6850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d24014-337a-4204-8efe-4a2c46ae6850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387875354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af943a5f-8807-4ec7-a88f-8a72a41ba7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:30Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b39d5c-0f45-4be0-920e-fca4c33707ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b39d5c-0f45-4be0-920e-fca4c33707ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae3205-d2de-45ac-b845-e12877605b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ae3205-d2de-45ac-b845-e12877605b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af943a5f-8807-4ec7-a88f-8a72a41ba7aa', 'volume_name': 'volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6505c58e-1690-4678-9c67-9237d50cb07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6505c58e-1690-4678-9c67-9237d50cb07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97461ea9-72e2-40d8-ab0c-d9c2b547a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume af943a5f-8807-4ec7-a88f-8a72a41ba7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa', 'volume_size': 1} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:30 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8" returned: 0 in 1.581s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:30 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8 Jun 15 07:41:30 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:30 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c" returned: 0 in 1.073s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:30 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e 1073741824" returned: 0 in 1.382s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:30 devstack sudo[111206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c Jun 15 07:41:30 devstack sudo[111206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:30 devstack sudo[111208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e Jun 15 07:41:30 devstack sudo[111208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (e98737e6-0c9f-4ce3-b740-241bd93152c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e46566-1028-44fb-b4be-08f2073a38dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e46566-1028-44fb-b4be-08f2073a38dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151915249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e424a2-d392-46be-a5d0-bc8665ed6f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:31Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b54637-f979-48a3-8f40-5c2f35fb0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b54637-f979-48a3-8f40-5c2f35fb0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dd9ce7-4753-4527-b6e9-26eaa99664aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dd9ce7-4753-4527-b6e9-26eaa99664aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e424a2-d392-46be-a5d0-bc8665ed6f82', 'volume_name': 'volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bf9d06-db97-4270-a3c0-c7aed38d52a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bf9d06-db97-4270-a3c0-c7aed38d52a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a1e6e-d36e-47e3-acef-ed76c48126b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume c0e424a2-d392-46be-a5d0-bc8665ed6f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82', 'volume_size': 1} Jun 15 07:41:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:31 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-7199b11a-582d-43d9-a55d-555d197c5da8" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-7199b11a-582d-43d9-a55d-555d197c5da8" released by "delete_volume" :: held 2.392s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['94a4eb16-e700-4f41-bbc9-1630e7574200', 'b9f8c59a-c9f3-400b-a5de-dc059d8dcc99', 'b1b8c030-63af-49d0-ba17-fc6e68948560', '686f33fd-4234-4696-9e2f-f112d9c910d3'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:31 devstack sudo[111213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:31 devstack sudo[111213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:31 devstack sudo[111206]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c" returned: 1 in 0.902s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5938f602-cf9a-455a-bb60-f45b983da940_ug4fsr7c' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec99f9-dbb4-4bc5-bcc3-28f16e75d435]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:31 devstack sudo[111208]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e" returned: 0 in 0.782s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.404s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330060274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0525f7-30ad-4534-a08d-575b18a4a42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:29Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume 6f0525f7-30ad-4534-a08d-575b18a4a42c {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:31 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2094a2-6645-44b3-8433-fec08a52d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b16db06-3b62-4b8a-abb4-28deed3f981e', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3de5a70-4b73-42fe-a747-85d436430fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:31 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-2b16db06-3b62-4b8a-abb4-28deed3f981e (2b16db06-3b62-4b8a-abb4-28deed3f981e): created successfully Jun 15 07:41:31 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c 1073741824 Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3de5a70-4b73-42fe-a747-85d436430fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:31 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:31 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (587b69b2-7dc7-4446-96e0-015371569dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:31 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:31 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:31 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d879768f-aa7f-4cb1-8041-0af68ef4c283 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:32 devstack sudo[111213]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.764s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-2593e81b-700f-4dbd-a5ee-1b2dd69901d4 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-7199b11a-582d-43d9-a55d-555d197c5da8-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-2676b429-994d-49be-a2f7-3ea9b755f932-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-2676b429-994d-49be-a2f7-3ea9b755f932-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:32 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-2676b429-994d-49be-a2f7-3ea9b755f932" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-2676b429-994d-49be-a2f7-3ea9b755f932" acquired by "delete_volume" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7391064-6649-4843-8cd0-9551b8bc8dc6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:32 devstack sudo[111226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD Jun 15 07:41:32 devstack sudo[111226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:32 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 Jun 15 07:41:32 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:32 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c 1073741824" returned: 0 in 1.119s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:32 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c Jun 15 07:41:32 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:33 devstack sudo[111226]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD" returned: 1 in 0.850s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] 5938f602-cf9a-455a-bb60-f45b983da940 was raw, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:33 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:33 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:33 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932" returned: 0 in 1.023s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:33 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932 Jun 15 07:41:33 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:33 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c" returned: 0 in 0.736s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2114358680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c9d43f-c1c1-4806-87d8-f22fe0897b90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:30Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume b4c9d43f-c1c1-4806-87d8-f22fe0897b90 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:33 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396fe6d5-0072-452b-a7b0-c0a306a300c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0525f7-30ad-4534-a08d-575b18a4a42c', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad29a52-151c-4dfd-8ddb-1c681af18063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:33 devstack sudo[111244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 1073741824 Jun 15 07:41:33 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:33 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-6f0525f7-30ad-4534-a08d-575b18a4a42c (6f0525f7-30ad-4534-a08d-575b18a4a42c): created successfully Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad29a52-151c-4dfd-8ddb-1c681af18063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:33 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (ea8c00bf-bba8-4a42-90bc-b0c76d2e9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:33 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3e60564a-1e4f-44b4-a69c-18bbbbb9e82d tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:33 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 0 in 0.894s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5938f602-cf9a-455a-bb60-f45b983da940_ildnbqakdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:41:34 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:34 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1G Jun 15 07:41:34 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:34 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2676b429-994d-49be-a2f7-3ea9b755f932" returned: 0 in 0.844s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-2676b429-994d-49be-a2f7-3ea9b755f932" released by "delete_volume" :: held 1.917s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['569b0d1e-177c-403d-abcb-e1576aae0d54', 'b7ee1dea-4256-4fb9-b721-6ab6723b3ba1', 'd402db21-2884-4027-9d74-def341fb4307', '4bb0da62-1ccc-42b6-ae44-f9965eb529e2'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:34 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 1073741824" returned: 0 in 1.005s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:34 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:34 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:34 devstack sudo[111258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 Jun 15 07:41:34 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-8bdb51b4-4847-43ee-8449-3dd0fe347acb-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-8bdb51b4-4847-43ee-8449-3dd0fe347acb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-8bdb51b4-4847-43ee-8449-3dd0fe347acb" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-8bdb51b4-4847-43ee-8449-3dd0fe347acb" acquired by "delete_volume" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cafd51e-18b2-4d7f-a2b4-c1bd155b3fa8]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:34 devstack sudo[111260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb Jun 15 07:41:34 devstack sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:35 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 1G" returned: 0 in 1.031s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1794532-967d-4bfa-8fc5-d715cffb9e0c]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:35 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" returned: 0 in 0.698s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.814s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-387875354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af943a5f-8807-4ec7-a88f-8a72a41ba7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:30Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume af943a5f-8807-4ec7-a88f-8a72a41ba7aa {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:35 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f6a9f5c-19df-489a-b27b-b5dd66710585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:35 devstack sudo[111274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa 1073741824 Jun 15 07:41:35 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aea645-f5da-4958-84cc-56efa17d3c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:35 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 (b4c9d43f-c1c1-4806-87d8-f22fe0897b90): created successfully Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92aea645-f5da-4958-84cc-56efa17d3c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:35 devstack sudo[111271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:35 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (0dd275ff-7a82-44b5-a726-ca361bcc3bc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-cb1d8b13-8772-4b56-bffd-745d4066c5d0 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:35 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.999s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:35 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-0b254584-5dd9-44e6-a9b1-429c158ce4a7 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-2676b429-994d-49be-a2f7-3ea9b755f932-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:35 devstack sudo[111260]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb" returned: 0 in 0.893s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:35 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb Jun 15 07:41:35 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:36 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 0 in 1.002s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:36 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:36 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:36 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8bdb51b4-4847-43ee-8449-3dd0fe347acb" returned: 0 in 0.779s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-8bdb51b4-4847-43ee-8449-3dd0fe347acb" released by "delete_volume" :: held 1.743s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:36 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa 1073741824" returned: 0 in 1.251s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['44a2dc83-ba40-44c1-a977-03690b1445f0', 'b29fd74e-f5f7-4379-9a27-d51541b2ebdd', 'f797ef8d-e4cd-4874-a251-4b214d08b648', '4f39f5b6-76f9-4ae2-b880-6c784f481251'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:36 devstack sudo[111293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa Jun 15 07:41:36 devstack sudo[111293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:36 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:36 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "cinder-quobyte-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d013eac-9711-4197-b155-6e934b5afc92]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:37 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 1 in 1.003s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Downloaded image 5938f602-cf9a-455a-bb60-f45b983da940 ((None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}])) to volume f3992aae-4976-4772-945c-215a0c18b624 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Temporary image 5938f602-cf9a-455a-bb60-f45b983da940 for user ce85259cfd5c4792bd400ed624b80b6e is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Marking volume f3992aae-4976-4772-945c-215a0c18b624 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Copying metadata from image 5938f602-cf9a-455a-bb60-f45b983da940 to f3992aae-4976-4772-945c-215a0c18b624. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Creating volume glance metadata for volume f3992aae-4976-4772-945c-215a0c18b624 backed by image 5938f602-cf9a-455a-bb60-f45b983da940 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5938f602-cf9a-455a-bb60-f45b983da940', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e8ae8d678f3040885f9a96a6aa9cbf5d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebb23d0-224c-4992-a2b7-e050c1422826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3992aae-4976-4772-945c-215a0c18b624', 'volume_size': 1, 'image_id': '5938f602-cf9a-455a-bb60-f45b983da940', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5938f602-cf9a-455a-bb60-f45b983da940', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e8ae8d678f3040885f9a96a6aa9cbf5d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b4043e630384c0790df9d7bd2eabced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bfa42b51d317e818825db86534b26524ffa4176e3f29bc9dc5ccaeb7b825d934d9c142d1abc3bc479a388e137a917ecdbcea56bb063e4071c70f443e05029a78', 'id': '5938f602-cf9a-455a-bb60-f45b983da940', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5938f602-cf9a-455a-bb60-f45b983da940/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723738bf-6ea7-4906-b558-99b1290b93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Volume volume-f3992aae-4976-4772-945c-215a0c18b624 (f3992aae-4976-4772-945c-215a0c18b624): created successfully Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723738bf-6ea7-4906-b558-99b1290b93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Flow 'volume_create_manager' (e374d424-0653-4b74-a5d1-431243f34cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6f5b5932-1968-4867-addb-c6610840ec63 tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Created volume successfully. Jun 15 07:41:37 devstack sudo[111300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 Jun 15 07:41:37 devstack sudo[111300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:37 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.806s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-d9a9f53f-2e62-4f25-884e-838581b21295 tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-8bdb51b4-4847-43ee-8449-3dd0fe347acb-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:37 devstack sudo[111293]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" returned: 0 in 0.956s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.623s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151915249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e424a2-d392-46be-a5d0-bc8665ed6f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775c00559e7644a49aa8c4eca3f9a9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:31Z,use_quota=True,user_id='f61fc5a3937c414fa99a5d8ca2f36db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Creating volume c0e424a2-d392-46be-a5d0-bc8665ed6f82 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97461ea9-72e2-40d8-ab0c-d9c2b547a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:37 devstack sudo[111304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 1073741824 Jun 15 07:41:37 devstack sudo[111304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b6cdd4-eba0-4998-bf27-492447d4c772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa (af943a5f-8807-4ec7-a88f-8a72a41ba7aa): created successfully Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b6cdd4-eba0-4998-bf27-492447d4c772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:37 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (e089a1fb-39a1-48ee-b2a6-2fb69e20c79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:37 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-096f7f08-7d35-475a-91a1-e967e21137d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:38 devstack sudo[111300]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" returned: 0 in 0.928s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:38 devstack sudo[111310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2 Jun 15 07:41:38 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Acquiring lock "cinder-f3992aae-4976-4772-945c-215a0c18b624-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "cinder-f3992aae-4976-4772-945c-215a0c18b624-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Acquiring lock "cinder-quobyte-f3992aae-4976-4772-945c-215a0c18b624" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "cinder-quobyte-f3992aae-4976-4772-945c-215a0c18b624" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cc863c-ee38-475e-af79-dfa867a83cdb]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:38 devstack sudo[111319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:38 devstack sudo[111319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:38 devstack sudo[111304]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 1073741824" returned: 0 in 1.138s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:38 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 Jun 15 07:41:38 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:38 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" returned: 0 in 0.885s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-quobyte-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2" released by "delete_volume" :: held 1.874s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Created reservations ['2b2a21f5-5e8e-49e0-a3e7-beafd38c715c', 'c65099e5-2a69-4e2b-a24d-be61fe959cc8', '8a776120-d3b7-4d94-b9d6-3e952f7652d1', '2dd1aaee-ca04-472a-9fa8-4c9293d619d8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:39 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:39 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:39 devstack sudo[111319]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 0 in 0.928s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:39 devstack sudo[111328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:39 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:39 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82" returned: 0 in 0.983s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a1e6e-d36e-47e3-acef-ed76c48126b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a49487-630a-45ac-8df1-180e3569a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:39 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Volume volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 (c0e424a2-d392-46be-a5d0-bc8665ed6f82): created successfully Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a49487-630a-45ac-8df1-180e3569a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Flow 'volume_create_manager' (e98737e6-0c9f-4ce3-b740-241bd93152c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-0fb9d81f-7e12-4e41-a964-bd020c594aef tempest-CreateVolumesFromSnapshotTest-219778853 None] Created volume successfully. Jun 15 07:41:39 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.826s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:39 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Deleted volume successfully. Jun 15 07:41:39 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-6c0109ff-f17b-4fb5-82b9-06ab092f5c8d tempest-CreateVolumesFromSourceVolumeTest-2075315091 None] Lock "cinder-6ddc04bc-dc8a-4dc8-8ef9-6dd499c818c2-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:40 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 1 in 0.845s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:40 devstack sudo[111335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624 Jun 15 07:41:40 devstack sudo[111335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-c0e424a2-d392-46be-a5d0-bc8665ed6f82-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-c0e424a2-d392-46be-a5d0-bc8665ed6f82-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:40 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-c0e424a2-d392-46be-a5d0-bc8665ed6f82" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-c0e424a2-d392-46be-a5d0-bc8665ed6f82" acquired by "delete_volume" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab56f30-1459-4871-ad7a-42098176f6bf]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:41 devstack sudo[111335]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f3992aae-4976-4772-945c-215a0c18b624" returned: 0 in 0.906s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "cinder-quobyte-f3992aae-4976-4772-945c-215a0c18b624" released by "delete_volume" :: held 2.768s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:41 devstack sudo[111338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 Jun 15 07:41:41 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Created reservations ['8ef8ccb8-2a93-49da-9384-69fc65fe320e', '62b68c94-67f3-4612-a7ec-3c38751320ee', '01963332-a5d8-437f-b69f-72ac93a1f2a4', 'c1a36b2c-8e5d-4634-b7b0-c378a85e76b8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:41 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:41 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:41 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:42 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.778s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:42 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Deleted volume successfully. Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8ae49cdc-c18d-4fc0-829e-20bacb9bf3cc tempest-VolumeAndVolumeTypeFromImageTest-556597913 None] Lock "cinder-f3992aae-4976-4772-945c-215a0c18b624-delete_volume" released by "delete_volume" :: held 3.882s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:42 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82" returned: 0 in 1.175s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:42 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82 Jun 15 07:41:42 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:42 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-c0e424a2-d392-46be-a5d0-bc8665ed6f82" returned: 0 in 0.751s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:42 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-c0e424a2-d392-46be-a5d0-bc8665ed6f82" released by "delete_volume" :: held 1.983s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['685eb59a-714e-462b-82b7-565a5c28bfed', 'c77b3005-0143-4ca3-8936-db1405c86b9f', 'd349f1dd-9af2-4f52-bb18-32f35ba66aa9', 'eb9d4b24-56a0-44e0-8e33-34c2b536ab2b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:43 devstack sudo[111350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:43 devstack sudo[111350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-af943a5f-8807-4ec7-a88f-8a72a41ba7aa-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-af943a5f-8807-4ec7-a88f-8a72a41ba7aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Flow 'volume_create_manager' (4a899129-a19e-401f-992f-94f40b1c63bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecd24f3-8e79-4223-8d16-eb9c507d8162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecd24f3-8e79-4223-8d16-eb9c507d8162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597e3cb-cadb-474e-a808-4db0614b2f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e5c65407a2433788544aae7a1d0107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:43Z,use_quota=True,user_id='aa9bf89fea1e48f7b1a0b1e1b777dd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7627b2-775b-41ea-9601-a4911eef390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7627b2-775b-41ea-9601-a4911eef390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d11b24-a2df-4e64-8813-47a439e7704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d11b24-a2df-4e64-8813-47a439e7704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8597e3cb-cadb-474e-a808-4db0614b2f7d', 'volume_name': 'volume-8597e3cb-cadb-474e-a808-4db0614b2f7d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d8354d-0afd-4e6b-8714-b0ad9fd3b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d8354d-0afd-4e6b-8714-b0ad9fd3b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411144e-ae96-4f2a-8f27-de5ecbfdcf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:43 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Volume 8597e3cb-cadb-474e-a808-4db0614b2f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8597e3cb-cadb-474e-a808-4db0614b2f7d', 'volume_size': 1} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597e3cb-cadb-474e-a808-4db0614b2f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e5c65407a2433788544aae7a1d0107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:43Z,use_quota=True,user_id='aa9bf89fea1e48f7b1a0b1e1b777dd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Creating volume 8597e3cb-cadb-474e-a808-4db0614b2f7d {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:43 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" acquired by "delete_volume" :: waited 0.111s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:43 devstack sudo[111352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d 1073741824 Jun 15 07:41:43 devstack sudo[111352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d9681-991e-47a2-82f8-68d660f2782a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:43 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:43 devstack sudo[111354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa Jun 15 07:41:43 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:44 devstack sudo[111350]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.866s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:44 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-c791748a-2169-4e63-8bc8-2260422006d8 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-c0e424a2-d392-46be-a5d0-bc8665ed6f82-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:44 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" returned: 0 in 0.912s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:44 devstack sudo[111364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa Jun 15 07:41:44 devstack sudo[111364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:44 devstack sudo[111352]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d 1073741824" returned: 0 in 1.150s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:44 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:44 devstack sudo[111367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d Jun 15 07:41:44 devstack sudo[111367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:45 devstack sudo[111364]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" returned: 0 in 0.766s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-af943a5f-8807-4ec7-a88f-8a72a41ba7aa" released by "delete_volume" :: held 1.749s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['2a3fc429-9668-43fc-af2a-2de52bfc15cd', '6c9e9e2a-805c-4e58-9182-dba51a50bcd5', '5e926fad-3a41-4f36-bb71-52df60db3c52', 'e143d4db-08aa-450a-83cf-cfe7e880eed0'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:45 devstack sudo[111367]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4411144e-ae96-4f2a-8f27-de5ecbfdcf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8597e3cb-cadb-474e-a808-4db0614b2f7d', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8183b616-01d8-4f76-8071-e776b5100c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:45 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Volume volume-8597e3cb-cadb-474e-a808-4db0614b2f7d (8597e3cb-cadb-474e-a808-4db0614b2f7d): created successfully Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8183b616-01d8-4f76-8071-e776b5100c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Flow 'volume_create_manager' (4a899129-a19e-401f-992f-94f40b1c63bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:45 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-357aba2c-3285-40bd-8659-df089bcf2a5a tempest-CinderUnicodeTest-585368968 None] Created volume successfully. Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:45 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:45 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-b4c9d43f-c1c1-4806-87d8-f22fe0897b90-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-b4c9d43f-c1c1-4806-87d8-f22fe0897b90-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9725148-a96f-4c27-9aeb-cedc04d8a406]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:45 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:46 devstack sudo[111373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 Jun 15 07:41:46 devstack sudo[111373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:46 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.833s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:46 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3a147bc1-bc16-41ec-85f7-36ff7a95716a tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-af943a5f-8807-4ec7-a88f-8a72a41ba7aa-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:46 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:46 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:46 devstack sudo[111373]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" returned: 0 in 0.914s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:46 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90 Jun 15 07:41:46 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Flow 'volume_create_manager' (09c93efb-43bf-4d61-bcbb-9ffc77937b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:47 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67af9388-bccb-4caa-b72b-fdcaf88c72b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.900s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67af9388-bccb-4caa-b72b-fdcaf88c72b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-651957283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392bf61b-5df5-4deb-a0cd-11f936dfe2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e5c65407a2433788544aae7a1d0107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:47Z,use_quota=True,user_id='aa9bf89fea1e48f7b1a0b1e1b777dd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37deb428-2d7c-4858-92c2-1e91e29a7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37deb428-2d7c-4858-92c2-1e91e29a7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf83f35b-4597-48e2-9aa4-737e5b10dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf83f35b-4597-48e2-9aa4-737e5b10dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392bf61b-5df5-4deb-a0cd-11f936dfe2f9', 'volume_name': 'volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216235f8-9c5a-4857-8f24-eed2ad621198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216235f8-9c5a-4857-8f24-eed2ad621198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f9d330-b9e6-4aa0-b9b8-aae98fadb430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:47 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Volume 392bf61b-5df5-4deb-a0cd-11f936dfe2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9', 'volume_size': 1} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-651957283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392bf61b-5df5-4deb-a0cd-11f936dfe2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e5c65407a2433788544aae7a1d0107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:47Z,use_quota=True,user_id='aa9bf89fea1e48f7b1a0b1e1b777dd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Creating volume 392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:47 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:47 devstack sudo[111385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 1073741824 Jun 15 07:41:47 devstack sudo[111385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:47 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" returned: 0 in 0.912s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-b4c9d43f-c1c1-4806-87d8-f22fe0897b90" released by "delete_volume" :: held 1.896s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['aa80f0e6-0b3e-4da1-ad44-a204274cd9bc', 'b7489242-acde-40e8-93c2-bc64e0f5ab78', '34f6dea3-cfc7-4ccd-a88d-a625b7bc2331', '442215b3-b5af-44a5-9ccf-a7115118c065'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:47 devstack sudo[111387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:47 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-6f0525f7-30ad-4534-a08d-575b18a4a42c-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-6f0525f7-30ad-4534-a08d-575b18a4a42c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-6f0525f7-30ad-4534-a08d-575b18a4a42c" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-6f0525f7-30ad-4534-a08d-575b18a4a42c" acquired by "delete_volume" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198c79d-d246-4e7b-8760-08168f5aca9c]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:48 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c Jun 15 07:41:48 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:48 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.827s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:48 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-3095e785-7867-4256-b76b-c772548a9321 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-b4c9d43f-c1c1-4806-87d8-f22fe0897b90-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:48 devstack sudo[111385]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 1073741824" returned: 0 in 1.197s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:48 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:48 devstack sudo[111396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 Jun 15 07:41:48 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:49 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c" returned: 0 in 0.918s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:49 devstack sudo[111401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c Jun 15 07:41:49 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:49 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" returned: 0 in 0.795s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f9d330-b9e6-4aa0-b9b8-aae98fadb430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aaf4f1-0138-477a-99f7-2bc955d3f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:49 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Volume volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 (392bf61b-5df5-4deb-a0cd-11f936dfe2f9): created successfully Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44aaf4f1-0138-477a-99f7-2bc955d3f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:49 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Flow 'volume_create_manager' (09c93efb-43bf-4d61-bcbb-9ffc77937b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:49 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-867aeede-d3a2-4f07-9d68-bd016cf5087b tempest-CinderUnicodeTest-585368968 None] Created volume successfully. Jun 15 07:41:50 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-6f0525f7-30ad-4534-a08d-575b18a4a42c" returned: 0 in 0.812s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-6f0525f7-30ad-4534-a08d-575b18a4a42c" released by "delete_volume" :: held 1.797s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['c3b2924b-45d1-4b31-a8f0-39480154f5da', 'f97daecd-5cf6-401e-b36e-9d7f01ec7b5c', '0ca401df-1471-4d2e-b5e9-e32f268cf4eb', 'a8523e78-cf68-4676-a673-e3a94aa8a04a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:50 devstack sudo[111406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:50 devstack sudo[111406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-2b16db06-3b62-4b8a-abb4-28deed3f981e-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-2b16db06-3b62-4b8a-abb4-28deed3f981e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-2b16db06-3b62-4b8a-abb4-28deed3f981e" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-2b16db06-3b62-4b8a-abb4-28deed3f981e" acquired by "delete_volume" :: waited 0.036s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1cf09-70ed-4be6-a181-cb35dc24671b]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:50 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:50 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e Jun 15 07:41:50 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Creating offline snapshot c505fd7a-2e3f-4263-817b-88d232eee955 of volume 392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[08341d1a-9dc1-4cec-92dc-86cb0430869d]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:51 devstack sudo[111406]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.067s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:51 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-baf814bf-4dfa-4c9e-97a7-a4e1089b1a5d tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-6f0525f7-30ad-4534-a08d-575b18a4a42c-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:51 devstack sudo[111411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 Jun 15 07:41:51 devstack sudo[111411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Flow 'volume_create_manager' (0fd192ea-71c0-433c-91d5-e26527841e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fef435-26a5-486d-955a-ad649b417d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fef435-26a5-486d-955a-ad649b417d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea058040f4248b6940924bc3301f316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:51Z,use_quota=True,user_id='579daf17bd6743cbbd94bb877f4337f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccb2ed5-385e-46a4-9841-9652207ee7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ccb2ed5-385e-46a4-9841-9652207ee7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80473bd1-3dbd-412b-b9dd-988eda9f93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG cinder.image.glance [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Creating Keystone auth plugin from conf {{(pid=91865) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 15 07:41:51 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e" returned: 0 in 1.054s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:51 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:51 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e Jun 15 07:41:51 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80473bd1-3dbd-412b-b9dd-988eda9f93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9', 'volume_name': 'volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9', 'volume_size': 1, 'image_id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f30e78824112cbf7f04c56025bd6aa8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ea058040f4248b6940924bc3301f316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '825ff51141c368f8c1ae6572c01d4cd51a0bfa1efc46198005f35f257f8be56bb733e5cc0337eaa264574da47a67b0aba95860c45d32dd1d666af08f7885fcaf', 'id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/804c105a-6b2d-45d0-a12c-4f87c8076950/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0fbe69-30d7-458e-aba3-a9f9f5522657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0fbe69-30d7-458e-aba3-a9f9f5522657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2b115-986f-4bda-8e2a-2346c1096afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:41:52 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9', 'volume_size': 1, 'image_id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f30e78824112cbf7f04c56025bd6aa8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ea058040f4248b6940924bc3301f316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '825ff51141c368f8c1ae6572c01d4cd51a0bfa1efc46198005f35f257f8be56bb733e5cc0337eaa264574da47a67b0aba95860c45d32dd1d666af08f7885fcaf', 'id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/804c105a-6b2d-45d0-a12c-4f87c8076950/file', 'properties': {}}, 'image_service': } Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Trying to clone bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 from image 804c105a-6b2d-45d0-a12c-4f87c8076950 at location (None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}]). {{(pid=91865) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 15 07:41:52 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Image download 0.00 MB at 0.00 MB/s Jun 15 07:41:52 devstack sudo[111411]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" returned: 0 in 0.978s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff67f61f-e420-4f33-bd3c-16133edbfa57]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:52 devstack sudo[111421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 1G Jun 15 07:41:52 devstack sudo[111421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:52 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-2b16db06-3b62-4b8a-abb4-28deed3f981e" returned: 0 in 0.707s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:52 devstack sudo[111423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:41:52 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-2b16db06-3b62-4b8a-abb4-28deed3f981e" released by "delete_volume" :: held 1.841s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['ca65b662-a383-43db-8bb0-a29cb2ba39d7', '348ad5bd-a39a-4c3f-aa00-c48fdea9111b', '0b68f6eb-3bf0-46ec-a60e-74811c392787', 'b4f09066-acdd-4ea7-b27a-677d8763a7ff'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:52 devstack sudo[111428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:41:52 devstack sudo[111428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-b22c32b7-5663-4fc2-b760-3c918a3ab820-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-b22c32b7-5663-4fc2-b760-3c918a3ab820-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-b22c32b7-5663-4fc2-b760-3c918a3ab820" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-b22c32b7-5663-4fc2-b760-3c918a3ab820" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleting offline snapshot b22c32b7-5663-4fc2-b760-3c918a3ab820 of volume f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] snapshot_file for this snap is: volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391fbb3-9e33-4b49-b8b8-03785869fee0]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:52 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:53 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:53 devstack sudo[111433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 0 in 0.904s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:53 devstack sudo[111433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:53 devstack sudo[111421]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 1G" returned: 0 in 1.071s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:53 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:41:53 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:53 devstack sudo[111439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 Jun 15 07:41:53 devstack sudo[111439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:53 devstack sudo[111428]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 1.007s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:41:53 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:41:53 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-60773dc8-5682-45b2-8394-2421257c4e12 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-2b16db06-3b62-4b8a-abb4-28deed3f981e-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:54 devstack sudo[111433]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820" returned: 0 in 1.136s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98699cd-49cc-4d68-8301-7f416852e2cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a2a4b2-a7be-4a36-b328-67b17c770106]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:54 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 1 in 1.043s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Temporary image 804c105a-6b2d-45d0-a12c-4f87c8076950 is fetched for user 579daf17bd6743cbbd94bb877f4337f5. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e308033-e39b-45b3-9f4a-0533c587c366]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:54 devstack sudo[111449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb Jun 15 07:41:54 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:54 devstack sudo[111439]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955" returned: 0 in 1.058s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:54 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 is being set with open permissions: ugo+rw Jun 15 07:41:54 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:54 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 Jun 15 07:41:54 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:54 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:41:54 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:55 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955" returned: 0 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:55 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb" returned: 0 in 0.951s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:55 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info Jun 15 07:41:55 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:55 devstack sudo[111466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 Jun 15 07:41:55 devstack sudo[111466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:55 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 0 in 0.869s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:55 devstack sudo[111469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:41:55 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:55 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info" returned: 0 in 0.752s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:55 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info is being set with open permissions: ugo+rw Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:55 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info Jun 15 07:41:55 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:55 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 1 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:41:55 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:56 devstack sudo[111466]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820" returned: 0 in 0.957s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:56 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820 Jun 15 07:41:56 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:56 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.info" returned: 0 in 0.685s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.377s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.555s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea058040f4248b6940924bc3301f316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:41:51Z,use_quota=True,user_id='579daf17bd6743cbbd94bb877f4337f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Creating volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:41:56 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:UPDATE=202,cinder:SELECT=140,cinder:INSERT=56,cinder:DELETE=17 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:41:56 devstack sudo[111516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1073741824 Jun 15 07:41:56 devstack sudo[111516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=140,cinder:UPDATE=200,cinder:DELETE=21,cinder:INSERT=45 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:41:56 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-ecdccbe3-e482-4ba6-a7c9-7fa3898b148c tempest-CinderUnicodeTest-585368968 None] Create snapshot completed successfully Jun 15 07:41:56 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb.b22c32b7-5663-4fc2-b760-3c918a3ab820" returned: 0 in 0.785s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-b22c32b7-5663-4fc2-b760-3c918a3ab820" released by "_delete_snapshot" :: held 3.981s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" released by "delete_snapshot" :: held 4.016s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:56 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['eb62c9b4-2635-4e38-a87b-02c548606fc8', 'c6ae0a95-f269-4cd5-97ae-3c51320dfec6', '7d4c2265-1d3e-4fe1-8162-1d55d2b64f79', 'a6d72c3f-37c8-47fe-81d7-df77e1340156'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:41:57 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Delete snapshot completed successfully. Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-001bcca9-17ce-42d3-9e6c-5f32b8f5b955 tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-b22c32b7-5663-4fc2-b760-3c918a3ab820-delete_snapshot" released by "delete_snapshot" :: held 4.310s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-c505fd7a-2e3f-4263-817b-88d232eee955-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-c505fd7a-2e3f-4263-817b-88d232eee955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-quobyte-c505fd7a-2e3f-4263-817b-88d232eee955" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-c505fd7a-2e3f-4263-817b-88d232eee955" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Deleting offline snapshot c505fd7a-2e3f-4263-817b-88d232eee955 of volume 392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:41:57 devstack sudo[111516]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] snapshot_file for this snap is: volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1073741824" returned: 0 in 1.050s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b29bb4-404b-4b74-945e-d32b4e8b9e8e]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:57 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:57 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:41:57 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:57 devstack sudo[111527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 Jun 15 07:41:57 devstack sudo[111527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-f98699cd-49cc-4d68-8301-7f416852e2cb-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-f98699cd-49cc-4d68-8301-7f416852e2cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[928efb95-8376-4068-a109-0ee22c2d5043]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:58 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 0 in 0.700s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Attempting download of 804c105a-6b2d-45d0-a12c-4f87c8076950 ((None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}])) to volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 15 07:41:58 devstack sudo[111527]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:58 devstack sudo[111535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb Jun 15 07:41:58 devstack sudo[111535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955" returned: 0 in 0.835s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e41107-1fbe-4914-a112-b98618c58c53]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4d1cc7-0235-4d5b-ba4b-3448af3106ac]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:41:58 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:58 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s Jun 15 07:41:58 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:58 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 Jun 15 07:41:58 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:59 devstack sudo[111535]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb" returned: 0 in 0.893s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:59 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb Jun 15 07:41:59 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:59 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s" returned: 0 in 0.760s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:59 devstack sudo[111549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s Jun 15 07:41:59 devstack sudo[111549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:41:59 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" returned: 0 in 1.048s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:41:59 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:41:59 devstack sudo[111554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 Jun 15 07:41:59 devstack sudo[111554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:00 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-f98699cd-49cc-4d68-8301-7f416852e2cb" returned: 0 in 0.861s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-quobyte-f98699cd-49cc-4d68-8301-7f416852e2cb" released by "delete_volume" :: held 1.840s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Created reservations ['4158f63d-e362-47df-a299-2c4071d686e7', '68b0153b-9ffb-475d-b055-43fc5655a90a', '27a9dc0b-e039-4675-b918-1cb39f056e59', 'fbeaf592-2799-43c2-997d-3ec29f10453d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:00 devstack sudo[111559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:00 devstack sudo[111559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:00 devstack sudo[111549]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s" returned: 1 in 1.023s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_804c105a-6b2d-45d0-a12c-4f87c8076950__6_kaz1s' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2ec74-ab3c-4179-9fe4-866ab0543268]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:00 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:42:00 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:00 devstack sudo[111554]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955" returned: 0 in 0.950s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:00 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:00 devstack sudo[111567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955 Jun 15 07:42:00 devstack sudo[111567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:01 devstack sudo[111559]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.853s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Deleted volume successfully. Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-cd483112-8b5a-4d29-ac37-29eef30c7b8f tempest-CreateVolumesFromSnapshotTest-219778853 None] Lock "cinder-f98699cd-49cc-4d68-8301-7f416852e2cb-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:01 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 0 in 0.936s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:01 devstack sudo[111567]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9.c505fd7a-2e3f-4263-817b-88d232eee955" returned: 0 in 0.741s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-c505fd7a-2e3f-4263-817b-88d232eee955" released by "_delete_snapshot" :: held 3.730s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Flow 'volume_create_manager' (5d67abb6-cec6-4911-9dd3-3faf304ec2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff83d1a3-24ed-4640-bf4f-ad6a37493b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" released by "delete_snapshot" :: held 3.799s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:01 devstack sudo[111573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD Jun 15 07:42:01 devstack sudo[111573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff83d1a3-24ed-4640-bf4f-ad6a37493b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824769084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3fccfc-9a49-4771-b49b-09de6ced0763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659bc8d7f06c4364968b9ff37e33645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:01Z,use_quota=True,user_id='eec63f3c4d634f8e92b29998d07bbf18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd67a89-a153-4c55-8edc-951cc6a139bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd67a89-a153-4c55-8edc-951cc6a139bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a1d681-b5db-4e09-812d-c7ead84e4a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a1d681-b5db-4e09-812d-c7ead84e4a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f3fccfc-9a49-4771-b49b-09de6ced0763', 'volume_name': 'volume-4f3fccfc-9a49-4771-b49b-09de6ced0763', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca95bd6e-049c-4b68-8e44-e74e851dfc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca95bd6e-049c-4b68-8e44-e74e851dfc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bcd89c-ec88-4e47-ad4b-c4fb34d9be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:01 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Volume 4f3fccfc-9a49-4771-b49b-09de6ced0763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f3fccfc-9a49-4771-b49b-09de6ced0763', 'volume_size': 1} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-824769084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f3fccfc-9a49-4771-b49b-09de6ced0763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659bc8d7f06c4364968b9ff37e33645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:01Z,use_quota=True,user_id='eec63f3c4d634f8e92b29998d07bbf18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Creating volume 4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:42:01 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:01 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 1073741824 Jun 15 07:42:01 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Created reservations ['73107e64-1b8e-4820-a3fb-a4ad5cc64367', '5f03afe4-d6d4-47f2-a63c-a8a54a436625', '525be4cb-da89-4f3c-b1da-a8d6695cb780', '9e7c2d5a-a221-4875-86ba-9f54a7e10e09'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:01 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Delete snapshot completed successfully. Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-aa1cb963-0eed-4f6a-a20d-90a43f7bcf0c tempest-CinderUnicodeTest-585368968 None] Lock "cinder-c505fd7a-2e3f-4263-817b-88d232eee955-delete_snapshot" released by "delete_snapshot" :: held 4.149s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-392bf61b-5df5-4deb-a0cd-11f936dfe2f9-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "cinder-392bf61b-5df5-4deb-a0cd-11f936dfe2f9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" acquired by "delete_volume" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbfc85b-4f6a-4435-b427-ffa4854db935]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:01 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:02 devstack sudo[111573]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD" returned: 1 in 0.860s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] 804c105a-6b2d-45d0-a12c-4f87c8076950 was raw, converting to raw {{(pid=91865) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:02 devstack sudo[111577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 Jun 15 07:42:02 devstack sudo[111577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:02 devstack sudo[111582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:02 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:02 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 1073741824" returned: 0 in 1.139s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:02 devstack sudo[111589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:02 devstack sudo[111589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:02 devstack sudo[111577]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" returned: 0 in 0.870s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:02 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9 Jun 15 07:42:02 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:02 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 0 in 0.843s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_804c105a-6b2d-45d0-a12c-4f87c8076950_8ppe4e0zdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:42:02 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Converted 0.00 MB image at 0.00 MB/s Jun 15 07:42:02 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:02 devstack sudo[111599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1G Jun 15 07:42:02 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:03 devstack sudo[111589]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.810s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bcd89c-ec88-4e47-ad4b-c4fb34d9be28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f3fccfc-9a49-4771-b49b-09de6ced0763', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362db323-63da-46dd-b6b8-608d1143c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:03 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Volume volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 (4f3fccfc-9a49-4771-b49b-09de6ced0763): created successfully Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362db323-63da-46dd-b6b8-608d1143c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Flow 'volume_create_manager' (5d67abb6-cec6-4911-9dd3-3faf304ec2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:03 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-b43d388f-5e8e-4b2e-9121-2f105c71dae7 tempest-SnapshotDependencyTests-1213318951 None] Created volume successfully. Jun 15 07:42:03 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" returned: 0 in 0.740s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-392bf61b-5df5-4deb-a0cd-11f936dfe2f9" released by "delete_volume" :: held 1.694s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Created reservations ['8fce7981-c399-4c1b-85ef-953257777468', 'a10f5ff5-d60c-4a19-a126-110975c301f9', 'b6d4b27d-491f-4cea-bc4d-7f35d8125601', '2b800489-68af-4779-bfc7-4f27d7ad6ee3'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:03 devstack sudo[111606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:03 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:03 devstack sudo[111606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 1G" returned: 0 in 0.787s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3b2d38-109e-402b-9ecb-88b84ab04ca6]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:03 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:03 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:03 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Flow 'volume_create_manager' (1f4824c2-4860-4d01-9cb1-02e7e82bcc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c39732-f2c6-488a-899f-01658b62ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-8597e3cb-cadb-474e-a808-4db0614b2f7d-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c39732-f2c6-488a-899f-01658b62ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1372998013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11235dc6-ce55-48db-be5e-f938e71aab70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0de3ca474594761b53b9e4c6cc1ccda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:04Z,use_quota=True,user_id='2b32f3e6a67a4273aec6a268fd6a2ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c448c37f-c30f-4718-bce4-fdb7bd29645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c448c37f-c30f-4718-bce4-fdb7bd29645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aa6b45-d376-4be8-8227-e4ce4b87a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aa6b45-d376-4be8-8227-e4ce4b87a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11235dc6-ce55-48db-be5e-f938e71aab70', 'volume_name': 'volume-11235dc6-ce55-48db-be5e-f938e71aab70', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986b72c5-4450-4433-8804-64f3149a8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986b72c5-4450-4433-8804-64f3149a8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf642b4-6af7-482e-a0d6-d8493fb45a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:04 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Volume 11235dc6-ce55-48db-be5e-f938e71aab70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11235dc6-ce55-48db-be5e-f938e71aab70', 'volume_size': 1} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1372998013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11235dc6-ce55-48db-be5e-f938e71aab70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0de3ca474594761b53b9e4c6cc1ccda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:04Z,use_quota=True,user_id='2b32f3e6a67a4273aec6a268fd6a2ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)}" {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Creating volume 11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:42:04 devstack cinder-volume[91865]: INFO cinder.volume.drivers.remotefs [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] casted to osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 1073741824 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "cinder-8597e3cb-cadb-474e-a808-4db0614b2f7d-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:04 devstack sudo[111610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 1073741824 Jun 15 07:42:04 devstack sudo[111610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Acquiring lock "cinder-quobyte-8597e3cb-cadb-474e-a808-4db0614b2f7d" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-8597e3cb-cadb-474e-a808-4db0614b2f7d" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6954396-aa53-4366-8b92-215e3b593976]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:04 devstack sudo[111606]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.684s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:04 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Deleted volume successfully. Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-56a328ed-0c8a-4dc5-bd13-d101e7be8e02 tempest-CinderUnicodeTest-585368968 None] Lock "cinder-392bf61b-5df5-4deb-a0cd-11f936dfe2f9-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:04 devstack sudo[111614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d Jun 15 07:42:04 devstack sudo[111614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:04 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 0 in 0.842s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:04 devstack sudo[111618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:04 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:04 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:05 devstack sudo[111610]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 1073741824" returned: 0 in 0.981s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:05 devstack sudo[111614]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d" returned: 0 in 0.923s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:05 devstack sudo[111627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d Jun 15 07:42:05 devstack sudo[111627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:05 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:05 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:05 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 1 in 0.789s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Downloaded image 804c105a-6b2d-45d0-a12c-4f87c8076950 ((None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}])) to volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 successfully. {{(pid=91865) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Temporary image 804c105a-6b2d-45d0-a12c-4f87c8076950 for user 579daf17bd6743cbbd94bb877f4337f5 is deleted. {{(pid=91865) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.volume_utils [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Marking volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 as bootable. {{(pid=91865) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Copying metadata from image 804c105a-6b2d-45d0-a12c-4f87c8076950 to bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9. {{(pid=91865) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Creating volume glance metadata for volume bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 backed by image 804c105a-6b2d-45d0-a12c-4f87c8076950 with: {'image_id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f30e78824112cbf7f04c56025bd6aa8b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=91865) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c2b115-986f-4bda-8e2a-2346c1096afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9', 'volume_size': 1, 'image_id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/804c105a-6b2d-45d0-a12c-4f87c8076950', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f30e78824112cbf7f04c56025bd6aa8b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ea058040f4248b6940924bc3301f316', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '825ff51141c368f8c1ae6572c01d4cd51a0bfa1efc46198005f35f257f8be56bb733e5cc0337eaa264574da47a67b0aba95860c45d32dd1d666af08f7885fcaf', 'id': '804c105a-6b2d-45d0-a12c-4f87c8076950', 'created_at': datetime.datetime(2026, 6, 15, 5, 41, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 15, 5, 41, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/804c105a-6b2d-45d0-a12c-4f87c8076950/file', 'properties': {}}, 'image_service': }' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579edaa-86b0-466f-9d1e-726ec872f6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:05 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Volume volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 (bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9): created successfully Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6579edaa-86b0-466f-9d1e-726ec872f6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Flow 'volume_create_manager' (0fd192ea-71c0-433c-91d5-e26527841e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:05 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-6ab3158a-a04b-44c2-b3b9-e26c3bc5743e tempest-VolumeImageDependencyTests-219447159 None] Created volume successfully. Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Acquiring lock "cinder-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "cinder-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Acquiring lock "cinder-quobyte-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "cinder-quobyte-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" acquired by "delete_volume" :: waited 0.017s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b357739-2dc3-4099-a927-cb429705c1fd]: (4, 'raw') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:05 devstack sudo[111627]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-8597e3cb-cadb-474e-a808-4db0614b2f7d" returned: 0 in 0.678s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "cinder-quobyte-8597e3cb-cadb-474e-a808-4db0614b2f7d" released by "delete_volume" :: held 1.657s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:05 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.726s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'} {{(pid=91865) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.156s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:05 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Creating offline snapshot 164094d2-9f11-4033-97ba-f1760c5874d8 of volume 4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:42:05 devstack sudo[111635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:06 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf642b4-6af7-482e-a0d6-d8493fb45a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11235dc6-ce55-48db-be5e-f938e71aab70', 'volume_size': 1}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adea7bb-d4fc-4085-8320-eecc6591357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a044e2dd-6a97-4203-9d49-42a271214223]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:06 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Volume volume-11235dc6-ce55-48db-be5e-f938e71aab70 (11235dc6-ce55-48db-be5e-f938e71aab70): created successfully Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adea7bb-d4fc-4085-8320-eecc6591357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Flow 'volume_create_manager' (1f4824c2-4860-4d01-9cb1-02e7e82bcc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:06 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-309e11cf-5bfe-4aa1-a002-2a4a61ed9256 tempest-VolumeDependencyTests-391119373 None] Created volume successfully. Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Created reservations ['602b01e7-887a-4e1c-956a-dc8e0603b5bd', '58b2aa0d-3c5a-4eb0-8892-6266f28a3b99', 'a4926ea3-c3f2-4ee0-8f04-3e3f61a95997', '9bda79a4-87f9-4c1d-a333-169cc4a5c58f'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:06 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:06 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:06 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:06 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:06 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 0 in 0.930s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:06 devstack sudo[111646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:06 devstack sudo[111646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:06 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.956s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:06 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:07 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 1G Jun 15 07:42:07 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:07 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.934s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:07 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Deleted volume successfully. Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-08ce57d5-7b72-465f-875c-22c05b1b226f tempest-CinderUnicodeTest-585368968 None] Lock "cinder-8597e3cb-cadb-474e-a808-4db0614b2f7d-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:07 devstack sudo[111646]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 1 in 0.882s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9' failed. Not Retrying. {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:07 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9 Jun 15 07:42:07 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:07 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 1G" returned: 0 in 1.011s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:07 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:08 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:08 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:08 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" returned: 0 in 0.708s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "cinder-quobyte-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9" released by "delete_volume" :: held 2.614s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Created reservations ['8bd79218-6edc-4417-be9e-beb89920b743', '4a7aed57-853c-474b-bc41-ffb0912a26c7', 'be59992a-181b-4d9a-855b-86090588ea6e', '978b9235-519e-40d4-bd5c-842089d759f8'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:08 devstack sudo[111664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:08 devstack sudo[111664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:08 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 0.715s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:08 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 is being set with open permissions: ugo+rw Jun 15 07:42:08 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:08 devstack sudo[111668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:08 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:09 devstack sudo[111664]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.663s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:09 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:09 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Deleted volume successfully. Jun 15 07:42:09 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-44c1fb0d-541b-4785-84a1-7fb38ee00e24 tempest-VolumeImageDependencyTests-219447159 None] Lock "cinder-bc6b5f70-2ba4-4b51-b9c1-aa1e1e8256f9-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:09 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 0.607s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:09 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:09 devstack sudo[111672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info Jun 15 07:42:09 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:10 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info" returned: 0 in 0.680s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:10 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info is being set with open permissions: ugo+rw Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:10 devstack sudo[111675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info Jun 15 07:42:10 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:10 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.info" returned: 0 in 0.632s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.708s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.150s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Creating offline snapshot fffd7afb-86db-429f-9d09-7f68b2d75125 of volume 11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 15 07:42:10 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-a843b8f3-2294-4719-868d-39ed5b71f938 tempest-SnapshotDependencyTests-1213318951 None] Create snapshot completed successfully Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866f0ae-232e-4259-8d6a-dc39d74c4593]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:10 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:10 devstack sudo[111678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:10 devstack sudo[111678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:11 devstack sudo[111678]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.704s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 1G {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:11 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 1G Jun 15 07:42:11 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Flow 'volume_create_manager' (a4ae299e-fd6b-471f-857f-99b6a8cf1f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492d2f0-4adb-475c-b48f-c7f89dd2bd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2492d2f0-4adb-475c-b48f-c7f89dd2bd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a354a47-ee04-432c-8508-7a30194919c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659bc8d7f06c4364968b9ff37e33645b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=164094d2-9f11-4033-97ba-f1760c5874d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:12Z,use_quota=True,user_id='eec63f3c4d634f8e92b29998d07bbf18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307d93e-db51-4bb4-83e1-e3882a0dee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4307d93e-db51-4bb4-83e1-e3882a0dee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36899e-b30c-4172-a1d7-403f44fa992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f36899e-b30c-4172-a1d7-403f44fa992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a354a47-ee04-432c-8508-7a30194919c6', 'volume_name': 'volume-4a354a47-ee04-432c-8508-7a30194919c6', 'volume_size': 1, 'snapshot_id': '164094d2-9f11-4033-97ba-f1760c5874d8'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cfe59b-a88c-472a-b98b-f232f66a1784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94cfe59b-a88c-472a-b98b-f232f66a1784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e72cef-3bc3-4033-85c8-1197bf9e102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:11 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Volume 4a354a47-ee04-432c-8508-7a30194919c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a354a47-ee04-432c-8508-7a30194919c6', 'volume_size': 1, 'snapshot_id': '164094d2-9f11-4033-97ba-f1760c5874d8'} Jun 15 07:42:11 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:12 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 1G" returned: 0 in 0.729s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11235dc6-ce55-48db-be5e-f938e71aab70 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:12 devstack sudo[111688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11235dc6-ce55-48db-be5e-f938e71aab70 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:12 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:12 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11235dc6-ce55-48db-be5e-f938e71aab70 -F qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.643s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:12 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 is being set with open permissions: ugo+rw Jun 15 07:42:12 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:12 devstack sudo[111693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:12 devstack sudo[111693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:13 devstack sudo[111693]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:13 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:13 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info Jun 15 07:42:13 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:14 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info" returned: 0 in 0.592s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:14 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info is being set with open permissions: ugo+rw Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:14 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info Jun 15 07:42:14 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:14 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.info" returned: 0 in 0.598s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.955s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.892s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8-4a354a47-ee04-432c-8508-7a30194919c6" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8-4a354a47-ee04-432c-8508-7a30194919c6" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Creating volume 4a354a47-ee04-432c-8508-7a30194919c6 from snapshot 164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:14 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-08a35850-b21d-4096-8248-c8ba4615f758 tempest-VolumeDependencyTests-391119373 None] Create snapshot completed successfully Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] snapshot: 164094d2-9f11-4033-97ba-f1760c5874d8, volume: 4a354a47-ee04-432c-8508-7a30194919c6, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2fff2a-94c0-4b1e-9030-701958ddcb13]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:14 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:14 devstack sudo[111704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:14 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=91865) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Flow 'volume_create_manager' (3ab44a0e-f774-4369-b064-166353c868d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9335a48e-98b3-414a-8c79-889b24869b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9335a48e-98b3-414a-8c79-889b24869b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-15T05:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-400386608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343a84a4-e217-42f8-b645-5649a31bbf24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0de3ca474594761b53b9e4c6cc1ccda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-15T05:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fffd7afb-86db-429f-9d09-7f68b2d75125,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-15T05:42:15Z,use_quota=True,user_id='2b32f3e6a67a4273aec6a268fd6a2ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d8e2cf6-d6c3-4bef-9d6d-43171b393dde),volume_type_id=1d8e2cf6-d6c3-4bef-9d6d-43171b393dde)' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16989f7-70e3-45ed-b8f9-e8adcdc574ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16989f7-70e3-45ed-b8f9-e8adcdc574ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de260b8-ff6b-41bd-be2e-81b70a5e8a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de260b8-ff6b-41bd-be2e-81b70a5e8a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '343a84a4-e217-42f8-b645-5649a31bbf24', 'volume_name': 'volume-343a84a4-e217-42f8-b645-5649a31bbf24', 'volume_size': 1, 'snapshot_id': 'fffd7afb-86db-429f-9d09-7f68b2d75125'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a66b6f-c391-41fb-a266-dda7cd4bbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a66b6f-c391-41fb-a266-dda7cd4bbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048b4682-480f-4829-b03e-d3d990f96051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:15 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Volume 343a84a4-e217-42f8-b645-5649a31bbf24: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-343a84a4-e217-42f8-b645-5649a31bbf24', 'volume_size': 1, 'snapshot_id': 'fffd7afb-86db-429f-9d09-7f68b2d75125'} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:15 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 0.756s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f3fccfc-9a49-4771-b49b-09de6ced0763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae33c445-926b-4d9a-b3ff-2cba93996c64]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:15 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:15 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:15 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:16 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:16 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:42:16 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:16 devstack sudo[111714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 Jun 15 07:42:16 devstack sudo[111714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:20 devstack sudo[111714]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6" returned: 0 in 4.514s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:20 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ed119-cb0d-4ad3-8815-7fb524c41ad6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:20 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:20 devstack sudo[111728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:20 devstack sudo[111728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:21 devstack sudo[111728]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.865s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:21 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:42:21 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Converted 1024.00 MB image at 226.78 MB/s Jun 15 07:42:21 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 is being set with open permissions: ugo+rw Jun 15 07:42:21 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:21 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 Jun 15 07:42:21 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:22 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6" returned: 0 in 0.560s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" released by "_copy_volume_from_snapshot" :: held 7.487s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8-4a354a47-ee04-432c-8508-7a30194919c6" released by "_create_volume_from_snapshot" :: held 7.522s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.550s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.798s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125-343a84a4-e217-42f8-b645-5649a31bbf24" by "_create_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125-343a84a4-e217-42f8-b645-5649a31bbf24" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Creating volume 343a84a4-e217-42f8-b645-5649a31bbf24 from snapshot fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Selected osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d as target Quobyte volume. {{(pid=91865) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" by "_copy_volume_from_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e72cef-3bc3-4033-85c8-1197bf9e102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a354a47-ee04-432c-8508-7a30194919c6', 'volume_size': 1, 'snapshot_id': '164094d2-9f11-4033-97ba-f1760c5874d8'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d5cc9c-7f57-4405-af58-b7a9a6914b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] snapshot: fffd7afb-86db-429f-9d09-7f68b2d75125, volume: 343a84a4-e217-42f8-b645-5649a31bbf24, {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 15 07:42:22 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Volume volume-4a354a47-ee04-432c-8508-7a30194919c6 (4a354a47-ee04-432c-8508-7a30194919c6): created successfully Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d5cc9c-7f57-4405-af58-b7a9a6914b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Flow 'volume_create_manager' (a4ae299e-fd6b-471f-857f-99b6a8cf1f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8156d-1017-43c4-b386-7e8eb44ba975]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:22 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-32316ee9-32ce-4d87-9906-fb895f47055b tempest-SnapshotDependencyTests-1213318951 None] Created volume successfully. Jun 15 07:42:22 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:22 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-164094d2-9f11-4033-97ba-f1760c5874d8-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-164094d2-9f11-4033-97ba-f1760c5874d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Deleting offline snapshot 164094d2-9f11-4033-97ba-f1760c5874d8 of volume 4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] snapshot_file for this snap is: volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0d3766-660e-4c4e-b2c9-acdb9ad75473]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:22 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:22 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:22 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:23 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.725s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11235dc6-ce55-48db-be5e-f938e71aab70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Creating direct copy from snapshot {{(pid=91865) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[be67a40a-bcef-4f24-a9b0-0a309dc61c55]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:23 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:23 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:23 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 0.711s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f3fccfc-9a49-4771-b49b-09de6ced0763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7ebdd-45fc-4588-a5ba-e2e9fc56bcf6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:23 devstack sudo[111748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:23 devstack sudo[111748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:23 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.701s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG cinder.utils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Path /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 not found in is_blk_device check {{(pid=91865) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 15 07:42:23 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:23 devstack sudo[111753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 Jun 15 07:42:23 devstack sudo[111753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:24 devstack sudo[111748]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.713s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:24 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:24 devstack sudo[111758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:24 devstack sudo[111758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:25 devstack sudo[111758]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 1.297s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:25 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:25 devstack sudo[111777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8 Jun 15 07:42:25 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:26 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:26 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763.164094d2-9f11-4033-97ba-f1760c5874d8" returned: 0 in 1.281s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-164094d2-9f11-4033-97ba-f1760c5874d8" released by "_delete_snapshot" :: held 4.166s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:26 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" released by "delete_snapshot" :: held 4.195s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:26 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Created reservations ['c01ba96b-c836-4a6f-906e-c72d741a95c0', '4c810057-e1b7-45e4-ab9c-d763b5e0a8ee', '9a3c3b1f-a878-4b9a-9cf0-286ce37983aa', '503f765f-74d8-4535-9351-7db15983c122'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:26 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Delete snapshot completed successfully. Jun 15 07:42:27 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8d69e2e0-3992-45ae-a933-ee8fa021ba7d tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-164094d2-9f11-4033-97ba-f1760c5874d8-delete_snapshot" released by "delete_snapshot" :: held 4.482s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-4f3fccfc-9a49-4771-b49b-09de6ced0763-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-4f3fccfc-9a49-4771-b49b-09de6ced0763-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" acquired by "delete_volume" :: waited 0.046s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[2234c51e-8267-4cb4-b3ef-857978dafd54]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:28 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:28 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:28 devstack sudo[111753]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24" returned: 0 in 4.842s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72308cd-d727-4477-a49c-f1ac278e9c25]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:28 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:28 devstack sudo[111782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:28 devstack sudo[111782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:29 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.812s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:29 devstack sudo[111787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763 Jun 15 07:42:29 devstack sudo[111787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:29 devstack sudo[111782]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.858s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG cinder.image.image_utils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 {{(pid=91865) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 15 07:42:29 devstack cinder-volume[91865]: INFO cinder.image.image_utils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Converted 1024.00 MB image at 211.42 MB/s Jun 15 07:42:29 devstack cinder-volume[91865]: WARNING cinder.volume.drivers.remotefs [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 is being set with open permissions: ugo+rw Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:29 devstack sudo[111792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 Jun 15 07:42:29 devstack sudo[111792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:29 devstack sudo[111787]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4f3fccfc-9a49-4771-b49b-09de6ced0763" returned: 0 in 0.604s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4f3fccfc-9a49-4771-b49b-09de6ced0763" released by "delete_volume" :: held 1.516s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Created reservations ['ba0c456e-8291-4428-bf3b-7422a55dae09', 'e576fc01-08ab-41ea-9b7b-cbbb0b9ee834', 'cc29898e-130a-4c43-a51f-340d41ae11d0', '713233b8-db13-481b-a4ee-8ef1ff3b7e73'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:29 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:29 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:29 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:30 devstack sudo[111792]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24" returned: 0 in 0.589s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" released by "_copy_volume_from_snapshot" :: held 7.824s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125-343a84a4-e217-42f8-b645-5649a31bbf24" released by "_create_volume_from_snapshot" :: held 7.864s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.885s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (048b4682-480f-4829-b03e-d3d990f96051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343a84a4-e217-42f8-b645-5649a31bbf24', 'volume_size': 1, 'snapshot_id': 'fffd7afb-86db-429f-9d09-7f68b2d75125'}' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de26221-4e6d-4c23-854a-ef2fa6501081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 15 07:42:30 devstack cinder-volume[91865]: INFO cinder.volume.flows.manager.create_volume [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Volume volume-343a84a4-e217-42f8-b645-5649a31bbf24 (343a84a4-e217-42f8-b645-5649a31bbf24): created successfully Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de26221-4e6d-4c23-854a-ef2fa6501081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=91865) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Flow 'volume_create_manager' (3ab44a0e-f774-4369-b064-166353c868d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=91865) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 15 07:42:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-8e7a8c43-d0a6-4177-803c-99e7e69183ae tempest-VolumeDependencyTests-391119373 None] Created volume successfully. Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-4a354a47-ee04-432c-8508-7a30194919c6-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-4a354a47-ee04-432c-8508-7a30194919c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:30 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" acquired by "delete_volume" :: waited 0.025s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.597s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:30 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Deleted volume successfully. Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff439b58-a450-408c-b9c7-f4e1d0f122a6]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-852fdb04-55bf-434f-82a8-781aa75cb6b4 tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-4f3fccfc-9a49-4771-b49b-09de6ced0763-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:30 devstack sudo[111799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 Jun 15 07:42:30 devstack sudo[111799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-fffd7afb-86db-429f-9d09-7f68b2d75125-delete_snapshot" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-fffd7afb-86db-429f-9d09-7f68b2d75125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" by "delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" acquired by "delete_snapshot" :: waited 0.018s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125" by "_delete_snapshot" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Deleting offline snapshot fffd7afb-86db-429f-9d09-7f68b2d75125 of volume 11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] snapshot_file for this snap is: volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc4724-0cc2-4f43-abfe-c7c18a5a8693]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:30 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:30 devstack sudo[111801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:30 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:31 devstack sudo[111799]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6" returned: 0 in 0.679s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:31 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6 Jun 15 07:42:31 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:31 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.742s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.remotefs [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11235dc6-ce55-48db-be5e-f938e71aab70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=91865) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa6f66-3621-4b51-92f4-7c860f851e62]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:31 devstack sudo[111811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:31 devstack sudo[111811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:31 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-4a354a47-ee04-432c-8508-7a30194919c6" returned: 0 in 0.605s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-quobyte-4a354a47-ee04-432c-8508-7a30194919c6" released by "delete_volume" :: held 1.332s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Created reservations ['c2fe272b-fdb3-4e56-932e-1d0e9d1f6f4f', 'a3a9d4c2-e29d-4e80-82ab-e13c55d69be4', 'e09b8755-cdad-4a57-8f80-6fd406e59870', 'bcc88949-b1fe-45fd-a12a-ef2c86407b8d'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:31 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:31 devstack sudo[111814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:31 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:32 devstack sudo[111811]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.689s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:32 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:32 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:32 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.583s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:32 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Deleted volume successfully. Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-19a3cfbd-0b8b-437d-84af-21b94eda30bd tempest-SnapshotDependencyTests-1213318951 None] Lock "cinder-4a354a47-ee04-432c-8508-7a30194919c6-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:32 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.751s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:32 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:33 devstack sudo[111828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125 Jun 15 07:42:33 devstack sudo[111828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:33 devstack sudo[111828]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70.fffd7afb-86db-429f-9d09-7f68b2d75125" returned: 0 in 0.630s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-fffd7afb-86db-429f-9d09-7f68b2d75125" released by "_delete_snapshot" :: held 2.911s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" released by "delete_snapshot" :: held 2.935s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Created reservations ['011bc8ef-b1bf-468b-b8ce-23b44a7a1619', 'ac8d651d-69d2-4038-b081-af4d9fcbf37f', '003fdef7-d228-4635-b83f-213e969e1ad8', 'd980b601-a92a-4c70-bd38-75459f0faa8a'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:33 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Delete snapshot completed successfully. Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f2edfcce-822e-4e04-a910-4ad2a8c6db99 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-fffd7afb-86db-429f-9d09-7f68b2d75125-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-11235dc6-ce55-48db-be5e-f938e71aab70-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "cinder-11235dc6-ce55-48db-be5e-f938e71aab70-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" acquired by "delete_volume" :: waited 0.019s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2e9a8-b3f2-48cf-9bfc-05259e079a4a]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:33 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:34 devstack sudo[111833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:34 devstack sudo[111833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:34 devstack sudo[111833]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.716s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:34 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:34 devstack sudo[111839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70 Jun 15 07:42:34 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:35 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-11235dc6-ce55-48db-be5e-f938e71aab70" returned: 0 in 0.654s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-11235dc6-ce55-48db-be5e-f938e71aab70" released by "delete_volume" :: held 1.435s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Created reservations ['10af8ebd-33b4-4637-a884-bf9ab7f6ff5f', '472d22be-95c9-44bb-8f51-5e676169e8a4', 'bae87bc1-481a-4531-9502-96694ba49975', '869a556c-a91f-407b-a559-7d095c007b36'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:35 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:35 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:35 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-343a84a4-e217-42f8-b645-5649a31bbf24-delete_volume" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-343a84a4-e217-42f8-b645-5649a31bbf24-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:36 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.624s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:36 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Deleted volume successfully. Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" by "delete_volume" {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" acquired by "delete_volume" :: waited 0.021s {{(pid=91865) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-f72f7b61-d203-45d3-856a-4ca047ea245b tempest-VolumeDependencyTests-391119373 None] Lock "cinder-11235dc6-ce55-48db-be5e-f938e71aab70-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132acea-e1d8-443c-a1b3-6b3c541a9274]: (4, 'qcow2') {{(pid=92934) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:36 devstack sudo[111852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 Jun 15 07:42:36 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:36 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:36 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24" returned: 0 in 0.739s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:37 devstack sudo[111857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24 Jun 15 07:42:37 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:37 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b/volume-343a84a4-e217-42f8-b645-5649a31bbf24" returned: 0 in 0.635s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-quobyte-343a84a4-e217-42f8-b645-5649a31bbf24" released by "delete_volume" :: held 1.419s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG cinder.quota [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Created reservations ['88a8c9c4-231d-476f-8e9b-43779bbdd548', '0ddff77b-08a2-4e34-ad30-55a041c283b2', '5ab7c257-30ce-4e33-94e8-88bc3d9565c5', 'd56eec38-3f1f-4e69-a36c-eb33c1fc3c5b'] {{(pid=91865) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:37 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:37 devstack sudo[111861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:37 devstack sudo[111861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:38 devstack sudo[111861]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:38 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.627s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:38 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:38 devstack cinder-volume[91865]: INFO cinder.volume.manager [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Deleted volume successfully. Jun 15 07:42:38 devstack cinder-volume[91865]: DEBUG cinder.coordination [None req-4ae539e0-1449-4ec5-a869-bf5e79cf2398 tempest-VolumeDependencyTests-391119373 None] Lock "cinder-343a84a4-e217-42f8-b645-5649a31bbf24-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=91865) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d': None} {{(pid=91865) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG cinder.volume.drivers.quobyte [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f75add87-d706-4fc1-b593-063f9985ff2d'] {{(pid=91865) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.lockutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=91865) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 15 07:42:46 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 15 07:42:46 devstack sudo[111874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b Jun 15 07:42:46 devstack sudo[111874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 15 07:42:47 devstack sudo[111874]: pam_unix(sudo:session): session closed for user root Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG oslo_concurrency.processutils [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b5b6110ddede9ab32c832224c3fab7b" returned: 0 in 0.607s {{(pid=91865) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG cinder.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Notifying Schedulers of capabilities ... {{(pid=91865) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG oslo_service.periodic_task [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] Running periodic task VolumeManager._thread_info {{(pid=91865) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread count: 28 {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG cinder.volume.manager [None req-1dc20f69-fb12-4267-a7af-a371d68e91eb None None] thread info: [<_MainThread(MainThread, started 131062504558720)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=91865) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 15 07:42:47 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:DELETE=10,cinder:SELECT=79,cinder:INSERT=30,cinder:UPDATE=93 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 15 07:42:48 devstack cinder-volume[91865]: DEBUG dbcounter [-] [91865] Writing DB stats cinder:SELECT=89,cinder:INSERT=31,cinder:UPDATE=114,cinder:DELETE=6 {{(pid=91865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}